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Abstract. The main objects of our considerations are differential operators generated 
by a formally selfadjoint differential expression of an even order on the interval [0, b) (b < 
oo) with operator valued coefficients. We complement and develop the known Shtraus' 
results on generalized resolvents and characteristic matrices of the minimal operator Lq- 
Our approach is based on the concept of a decomposing boundary triplet which enables 
to establish a connection between the Straus' method and boundary value problems 
(for singular differential operators) with a spectral parameter in a boundary condition. 
In particular we provide a parametrization of all characteristic matrices 0(A) of the 
operator Lq immediately in terms of the Nevanlinna boundary parameter r(A). Such 
a parametrization is given in the form of the block-matrix representation of 0(A) as 
well as by means of the formula for 0(A) similar to the well known Krein-Naimark 
formula for generalized resolvents. In passing we obtain the representation of canonical 
and generalized resolvents in the form of integral operators with the operator kernel 
(the Green function) defined in terms of fundamental operator solutions of the equation 
l[y}-Xy = 0. 



1. Introduction 

Let f), H be Hilbert spaces, let A be a symmetric densely defined operator in Sj with 
deficiency indices n±(A) and let A be a selfadjoint (canonical or exit space) extension of 
A acting in a Hilbert space $) D fj. Moreover denote by [H] the set of all bounded linear 
operators in H. 

As is known the formula for generalized resolvents (in the Shtraus form) 

(1.1) R(A) = (A(A) - A) -1 , AeC+UC_ 

gives a bijective correspondence between all generalized resolvents R(A) := P^{A — A) -1 \ 
S) of A and all holomorphic families of extensions A(X) D A such that LmX ■ Im A(X) > 
and (1(A))* = 1(A). 

Next assume that A = [0, b) (b < oo) is an interval in R and 

n 

(1.2) l[y] = ^(-l) fc ((p„_ fc2 / (fc) ) {fc) - Wn-kV^)^ + (M M )1+WI 

fc=i 

is a formally selfadjoint differential expression of an even order 2n with the smooth 
enough coefficients Pk{'),Qk{') '■ A — > C. Denote by L Q and L minimal and maximal 
operators respectively induced by the expression (1.2) in the Hilbert space Sj := L 2 (A). 
It is known that L is a closed densely defined symmetric operator with not necessarily 
equal deficiency indices n±(L ) and Lq = L. 

Let Y Q (t, A) be the "canonical" 2n-component operator solution of the equation l[y] — 
Xy = (see (3.6)) and let J = codiag (— Ic n ) be a signature operator in C n © C n . 
By using formula (1.1) A.V. Shtraus showed [27] that each generalized resolvent R(A) of 
the minimal operator Lq admits the representation 

(1.3) (M(A)/)(x) = / G(x, t, X)f(t) dt, f = /(•) G 

o 
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where the kernel G(-, •, A) : A x A — > C is defined by 

(1.4) G(x,t,X) = Y Q (x, A)(fi(A) + | sgn(t- a;) J)y *(t, A), AgC+UC_. 

Here f2(-) : C + U C_ — > [C n © C ra ] is a Nevanlinna operator (matrix) function, which is 
called a characteristic matrix of the corresponding generalized resolvent M(A)[27]. Next 
by using the matrix fi(-) A.V. Shtraus constructed in [27] all spectral functions (both 
orthogonal and not orthogonal) of the operator L . Observe also that in [3] these results 
were extended to differential expressions (1.2) with operator valued coefficients. 

A rather different approach in the theory of spectral functions is based on the appli- 
cation of boundary value problems with a spectral parameter in a boundary condition 
(see [16, 9, 2] and the references therein). Namely let 

(1.5) l[y] = -y" + q(t)y, (q(t)=W)), te[0,oo) 

be a Sturm-Liouville expression such that n±(L ) = 1 (the limit point case at oo), let 
m(A) be the corresponding Titchmarsh-Weyl function [5, 23] and let R(A) be a generalized 
resolvent of the operator L . Then formula (1.1) immediately implies that there exists a 
Nevanlinna function r(A) such that for each / G the function y = K(A)/ is the unique 
solution of a boundary value problem 

(1.6) l[y] -\y = f 

(1.7) y(0)-r(AV(0) = 0, A G C+ U C_ 

Moreover as was shown in [9] the characteristic matrix Q(-) of the generalized resolvent 
R(A) is associated with the Nevanlinna parameter r(-) in (1.7) via 

, , m _ 1 /to(A)t(A) m(A)\ 

(L8) ^ (A) " m(A) + r(A) I m(A) -1 ) " 

In this connection note that the case ti±{Lq) = 2 is more complicated, since in this case 
the only boundary condition (1.7) at the point is not sufficient to define a selfadjoint 
extension of the operator L and, consequently, a spectral function. Moreover, the 
situation becomes essentially more complicated for a singular differential expression of a 
higher order. 

In the present paper we complement and develop the above results on generalized re- 
solvents and characteristic matrices. The main objects here are differential operators in 
the Hilbert space := L 2 (A; H) generated by a formally selfadjoint differential expres- 
sion (1.2) with operator valued coefficients Pk(-),Qk(-) '■ A — > [H] (dimiJ < oo). Denote 
by rib± deficiency indices of the expression l[y] at the end b of the interval A = [0,b) 
[20]. Our method is based on the concept of a decomposing D-triplet for L introduced 
in [20] for the case n&_ < n b+ . To simplify further considerations we suppose below that 
nb- = n b+ (and, therefore, n + (L ) = n_(L )). In this case a decomposing D-triplet can 
be replaced with a decomposing boundary triplet for L, which is defined as follows. 

Denote by T> the domain of the maximal operator L. Let W be a Hilbert space and 
let r^- : V — > 7i' , j G {0, 1} be linear maps. Construct linear operators F 3 ; : V — > 
H n @Hj, 3 €{0,1} by 

(1.9) r y = {y^(o),r' y}(eH n (Bn'), r iy = {-y( 1 \o),r' l y}(eH n ®H'), yev. 

(here y (1) (0), y {2) (0) G H n are vectors of the quasi- derivatives at the point 0, see (3.2)). 
Then a collection n = {Ti, r , I^}, where Ti :— H n ®W and r , Ti are linear maps (1.9), 
is called a decomposing boundary triplet for L if the map T = (T Ti) T is surjective 
and the following identity holds 

{Ly, z) - (y, Lz) = (Txy, T z) - (T y, T 1 z), y,z EV. 
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The last two conditions mean that II is a boundary triplet for L in the sense of [14]. 
Therefore according to [6] the equality 

FJ X = M(A) To/a, fx e m x (L ) := Ker(L - A), A G C + U C_ 

defines a uniformly strict Nevanlinna operator function M(A)(g \H\) which is called the 
Weyl function corresponding to the triplet II. In our case the function M(-) admits the 
block matrix representation 

(1.10) M(A) = (j^l) mJ(A)) : Rn © H ' - Rn © «'> A e C + U C - 

Formula (1.10) induces the uniformly strict Nevanlinna function m(A)(G [H n ]) which is 
called the m-function of the operator L . In the scalar case (dimH = 1) this function 
coincides with the classical characteristic (Titchmarsh-Weyl) function for decomposing 
boundary conditions (for more details see [20]). 

Next denote by R(7i) the set of all Nevanlinna operator pairs (Nevanlinna families of 
linear relations) [8] 

(1.11) r(A) = {(C (A), d(A)); H}, A G C+ U C_ 

with operator functions Co (A) and Ci(A) defined by the block-matrix representations 

(1.12) C (A) = (C%(A) C (A)) :H n ®n'^n, 

d(A) = (Ci(A) C[(X)) :H n ®n'^H. 

For a given f E S) and r(A) G i?(7i) consider a boundary value problem 
(1-13) l[y] -Xy = f 

(i.i4) c'i(A)y (1) (o) + c7 2 (A)y( 2 )(o) + c7 (A)r 0?/ - c7((A)r; y = o. 

A function y : A — > i7 is called a solution of the problem (1.13), (1.14) if it belongs to 
"D and obeys the equation (1.13) and the relation (1.14). 

For a regular expression l[y] (defined on a finite segment A = [0,6]) one can put 
F' y = y( 2 \b), r[y = y^(b) [24, 26], in which case the boundary condition (1.14) takes 
the "classical" form (c.f. [16]). For a singular expression l[y] the boundary operators 
r o and T[ can by explicitly defined in terms of limits of some regularizations of quasi- 
derivatives y^\t) at the point b (see Proposition 3.10 in [20]). Hence the relation (1.14) 
is a boundary condition given in terms of boundary values y^(0),y^(0) (at the regular 
end 0) and T' y, T[y (at the singular end b) of a function y G T>. Moreover, an application 
of V.M. Bruk's results [4] to the decomposing boundary triplet (1.9) gives the following 
theorem. 

Theorem 1.1. For every generalized resolvent R(A) of the minimal operator L there 
exists the unique operator pair r(A) G R(Ti) such that for every f G S) the function 
y = K(A)/ is the unique solution of the boundary value problem (1.13), (1.14), and, con- 
versely, for each r(A) G R(TL) the relations (1.13), (1.14) define a generalized resolvent 
of L . 

In view of Theorem 1.1 formulas (1.13), (1.14) parameterize all generalized resolvents 
R(A) by means of a Nevanlinna boundary parameter r(A). In the sequel this fact will be 
written as R(A) = R r (A). 

The main result of the paper is a description of all characteristic matrices fi(-) of the 
operator L immediately in terms of the boundary parameter r(A) G R{Ti). Namely, with 
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S(X) 



every Nevanlinna operator pair r(A) we associate an operator function fl T (-) : C + UC 
[H © Tt] , given by the block-matrix representation 
(1.15) 

O/u. (M{\) - M(X)(t(X) + M(A))- X M(A) -\I H + M(A)(r(A) + M(A))- 1 
" rlAj _ V ~Vn + (r(A) + M(A))- X M(A) " -(r(A) + M(A))- 1 

Next, the inclusion H n C ft(= # n © W) implies that H n ®H n dH®H. This enables 
to introduce the operator function Q T (-) : C + U C_ -> [H n © # n ] by 

(1.16) n T (\) = p H n m n n T (\) \ H n ®H n , x g c + u c_. 

We show in the paper that for every r(A) G R(TL) the Shtraus-Bruk characteristic matrix 
f2(-) of the corresponding generalized resolvent E r (A) obeys fi(A) = f2 r (A). Hence the 
equalities (1.15) and (1.16) give a parametrization of all characteristic matrices f2(-) 
in terms of a boundary parameter r(-) associated with the boundary value problem 
(1.13), (1.14). Moreover, the following theorem shows that the same parametrization 
can be given in the form similar to that of the well-known Krein-Naimark formula for 
generalized resolvents [18]. 

Theorem 1.2. Let A be a selfadjoint extension of L with the domain V(A ) — {y G 
V : (0) = 0, I> = 0} and let 

( ;'" A: ■ U [ f X ^ : //' © W -+ H" © //' . A G C + U C_, 

where m(A) and M 2 (A) are taken from (1.10). Then the characteristic matrix of the 

resolvent (A — A) -1 is f2o(A) = ( m (y) j an( i ^ e e q Ua lity 

\^2 Ih " u / 

(1.17) fi(A)(=fi r (A)) = fi (A)- 1 S(A)(r(A) + M(A))~ 1 5*(A), A G C + U C_ 

gives a bijective correspondence between all characteristic matrices f2(A) of the operator 
L and all Nevanlinna operator pairs r(-) G R(H). Moreover Q(X) is a characteristic 
matrix of a canonical resolvent if and only if r(A) = r = r* (A G C + U C_). 

Thus Theorem 1.2 together with formulas (1.3) and (1.4) establishes a connection 
between the boundary problem (1.13), (1.14) and the Shtraus' method in the theory of 
differential operators. 

Next by using (1.17) we prove the inequality 

(1.18) (ImX)- 1 ImQ T (X) > [ U*(t, X)U T (t, X) dt, X G C+ U C_, 

Jo 

which turns into the equality for canonical (orthogonal) characteristic matrices fi r (-). In 
formula (1.18) U T (t, A) is the operator solution of the equation (1.13), which is defined by 
some initial conditions written in terms of the operator functions (1.12). The inequality 

(1.18) immediately implies that fi T (') is a Nevanlinna function (c.f. proof of this fact 
in [27, 3]). Observe also that formula (1.18) is similar to that obtained in [1, 13] for 
different classes of boundary value problems. 

In the final part of the paper we consider the simplest situation 

(1.19) n b+ = n b _ = 0, 

which in the case dim// < oo is equivalent to the relation n + (L ) = n_(L ) = n dimH 
(minimality of the deficiency indices). It turns out that under the condition (1.19) the 
unique decomposing boundary triplet for L is II = {H n , T , Ti} with T y = y^(0), Yiy = 
-y (1) (0), y G V. Moreover by formulas (1.10) and (1.15), (1.16) M{X)= m(A) and the 
characteristic matrix Vt T (X) is defined by (1.15) (with Vt T (X) in place of VL T (X) ). The last 



ON GENERALIZED RESOLVENTS AND CHARACTERISTIC MATRICES 



5 



statement implies that the equality (1.8) for the Sturm-Liouville operator is a particular 
case of the general formula (1.15). Observe also that the form of the matrices (1.8) and 
(1.15) goes back to I.S. Kac [15]. 

In passing with the above main statements we obtain some results which, to our mind, 
are of a self-contained interest. In particular we complement and generalize the results 
from [25, 26] concerning operator fundamental solutions of the equation l[y] —Xy = and 
spectrum of differential operators (see Theorems 4.6 and 4.7). Moreover, in Theorems 
4.10 and 5.3 for the case dimH < oo canonical and generalized resolvents are given 
in the form of integral operators with the operator kernel (the Green function) defined 
immediately in terms of fundamental solutions. We suppose that such a representation 
of the Green function is new even in the scalar case for an operator L with equal 
intermediate deficiency indices n < n + (L ) = n_(L ) < In. 

In conclusion note that all specified results are actually obtained for differential op- 
erators with arbitrary (possibly unequal) deficiency indices by using the method of de- 
composing T>-triplets. In this way the known technique of boundary triplets [14, 6, 7] 
becomes slightly more complicated. 

2. Preliminaries 

2.1. Notations. The following notations will be used throughout the paper: f), H de- 
note Hilbert spaces; \Hi,H-}\ is the set of all bounded linear operators defined on Hi 
with values in Hi', [H] := [H, H\; A \ C is the restriction of an operator A onto the linear 
manifold C; P c is the orthogonal projector in ft onto the subspace C C $); C + (C_) is 
the upper (lower) half-plain of the complex plain. 

Recall that a closed linear relation from H to H± is a closed subspace in Ho © Hi- 
The set of all closed linear relations from Ho to H\ (from H to H) will be denoted by 
C (Ho, Tii) (C(H)). A closed linear operator T from Ho to Hi is identified with its graph 
grTeC(H ,Hi). 

For a relation T G C(Ho,Hi) we denote by V(T), 1Z(T) and KerT the domain, range 
and the kernel respectively. The inverse T" 1 and adjoint T* are relations defined by 

T- 1 = {{/', /} : {/, /'} G T}, T- 1 G C(Hi, Ho) 
T* = {{g,g'}eH 1 ®H :(f',g) = (f,g'), {/,/'} eT}, T* eC^Ho). 

In the case T G C(Ho,Hi) we write: 

G p(T) if KerT = {0} and 1Z(T) = H u or equivalently if T' 1 G [Hi,Ho\\ 
G p(T) if KerT = {0} and Tl(T) is a closed subspace in Hi, 

G a c (T) if KerT = {0} and U(T) =H X ^ U(T); 

G a p (T) if KerT ^ {0}; G a r (T) if KerT = {0} and TZ(T) ^ Hi. 
For a linear relation T G C(H) we denote by p(T) = {A G C : G p(T — A)} 
and p(T) = {A G C : G p(T — A)} the resolvent set and the set of regular type 
points of T respectively. Next, <j(T) = C\p(T) stands for the spectrum of T. The 
spectrum a(T) admits the following classification: a c (T) = {A G C : G cr c (T — A)} 
is the continuous spectrum; a p (T) = {A G C : G cr p (T — A)} is the point spectrum; 
cr r (T) = a(T) \ (o~ p (T) U o~ c (T)) = {A G C : G a r (T — A)} is the residual spectrum. 
Let T G C(H) be a densely defined operator. For any A G C we put 

m x (T) := Ker(T* - A) (= H TZ(T - A)). 

If A G p(T), then ^l\(T) is a defect subspace of the operator T. 



VADIM MOGILEVSKII 



In what follows we will use the operators Jh ,Hi £ \Ho@H\, HiOHo] and J H G [H®H] 
defined by 

(2.1) J HotHl = :Ho®H 1 ^H 1 ®'Ho and J n = J HjH . 

2.2. Holomorphic operator pairs. Let A be an open set in C, let /C, Ho, Hi be Hilbert 
spaces and let Kj(-) : A — > [/C, Hj], j G {0,1} be a pair of holomorphic operator 
functions. In what follows we identify such a pair with a holomorphic operator function 

(2.2) K{\) = {K {\) i^i(A)) T : K ->W ®Wi, A G A. 

Similarly a pair of holomorphic operator functions Cj(-) : A — > [7-^-,/C], j G {0, 1} will 
be identified with an operator function 

(2.3) C(A) = (C (A) Ci(A)) :W ©Wi->/C, A G A. 



A pair (2.2) will be called closed if K(X)K = K(X)IC, A G A. Moreover a pair (2.2) 
((2.3)) will be called admissible if KerAT(A) = {0} (respectively K(C(\)) = K) for all 
A G A. In the sequel all pairs (2.2) and (2.3) are admissible unless otherwise stated. 



Definition 2.1. Two pairs of holomorphic operator functions 

K®(\) = l^j^l) : Kj - H ®H! (C7^(A) = (Cf (A) Cf (A)) : H ©^i - £,-), 



where j G {1,2} and A G A, are said to be equivalent if K^(X) = K^(X)(p(X) (respec- 
tively C^(X) = (p(X)C^(X)) with a holomorphic isomorphism <p(-) : A — > [/Ci,/C 2 ]. 

It is clear that the set of all operator pairs (2.2) (respectively (2.3)) falls into nonin- 
tersecting classes of equivalent pairs. 

Definition 2.2. A function r(-) : A — > C(Ho,H\) is called holomorphic on A if there 
exists a holomorphic operator pair (2.2) such that r(A) = K(X)JC or equivalently 

(2.4) r(A) = {Ko(X), K^X); K] := {{K (X)h, K^h} : h G /C}, A G A. 

The relation (2.4) establishes a bijective correspondence between all holomorphic func- 
tions t(-) : A — > C(Ho,H±) and all equivalence classes of closed holomorphic pairs (2.2). 
Therefore we will identify (by means of (2.4)) a holomorphic C(Ho, 7ii)-valued function 
t(-) and the corresponding equivalence class of (closed) holomorphic pairs (2.2). Sim- 
ilarly we will identify an equivalence class of holomorphic operator pairs (2.3) and a 
function r(-) : A — > C(Hq,Hi) given for all A G A by 

(2.5) r(A) = {(C (A), d(A)); K] := {{h , h} G H © H, : C (A)/i + Ci(A)fci = 0}. 

It follows from the Liouville's theorem that in the case A = C pairs of holomorphic 
operator functions (2.2) and (2.3) turn into pairs of operators 

(2.6) K=(K Ki) T : /C — > Ho © H±, 

(2.7) C={C Ci) : Wo Wi -> /c. 

Moreover the equivalence of such pairs (in the sense of Definition 2.1) is realized by a 
(constant) isomorphism (p G [/Ci,/C 2 ]- Hence r(A) = 9, A G C and (2.4) takes the form 

(2.8) 9 = {K , K x ; K} := {{K h, K^} : h G /C}. 

Formula (2.8) gives a bijective correspondence between all linear relations 9 G C(H ,Hi) 
and all equivalence classes of closed operator pairs (2.6). Similarly the relation 

(2.9) 9 = {(Co, Ci); £} := {{/i , M G 7Yo © Hi : C h + = 0} 
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gives a bijective correspondence between all 9 G C(Tio,Tii) and all equivalence classes of 
operator pairs (2.7). Therefore we will denote by C (Tio, Tii) both the set of all closed 
linear relations from Tio to Tii and the set of all equivalence classes of operator pairs 
(2.6) ((2.7)), identifying them by means of (2.8)((2.9) respectively). 
The following lemma is immediate from Lemma 2.1 in [19]. 

Lemma 2.3. Let 9 = {(C ,Ci);)C} G C(Ti ,Tii), let 9* = {(C U ,C *);1C*} G C(Tii,Ti Q ) 
be the adjoint operator pair (linear relation) and let B G [Hi, Tio]- Then G p(Ci* + 
C *B) -<=>- G p(Cq + BCD an d following equality holds 

C{(C* + BCl)- 1 = (C u + C 0lf B)- l C Qif {= -(r* - B)- 1 ). 

Next recall some results and definitions from our paper [21]. 

Let Tii be a subspace in a Hilbert space Tio, let H 2 '■ = Ho Tii and let Pj be the 
orthoprojector in Ti onto Tij, j G {1,2}. With every linear relation 9 G C(H ,Hi) we 
associate a x-adjoint linear relation 9 X G C(Ho,Hi), which is defined as the set of all 
vectors k = {k , k{\ G Tio © Tii such that 

(h, h ) - (k , hi) + i(P 2 k , P 2 h ) = 0, {ho, h} G 9 

Using this definition and the correspondence (2.9) we introduce the notion of a x- 
adjoint operator pair (or more precisely a class of x-adjoint operator pairs) 9 X = 
{(C 0x , Cix); TC X } G C (Tio, Tii) corresponding to an operator pair 9 = {(C ,Ci);/C} G 
C (Tio, Tii). As was shown in [21] (# x ) x = 9. Moreover Proposition 3.1 in [21] implies 
that the adjoint operator pair 9* admits the representation 9* = {(Cu, Co*); JC X } with 

(2.10) Cu = Cox \ Tii, Co* = Cix-Pi — iCo x f2- 
It follows from (2.10) that 9 X = 6* in the case Tio = Tii ■= U. 

Definition 2.4. [21] A linear relation 9 G C(Ti ,Tii) belongs to the class Dis(Ti ,Tii) 
(Ac(Tio,Tii)) if ip e (h) := 2Im(hi,h ) + H^/toll 2 > (respectively ip e (h) < 0) for all 
h = {ho, hi} G 9 and there are not extensions 9 D 9, 9^9 with the same property. 

Note that in the case Tio — Tii —: Ti the class Dis(Ti,Ti) (Ac(Ti,Ti)) coincides with 
the set of all maximal dissipative (accumulative) linear relations in Ti. 
Next assume that K,' + and K!_ are Hilbert spaces and 

(2.11) t + (X) = {Ko(\),Ki(X);IC' + }, AGC + ; r_(A) = {N (X), Ni(X); A G C_ 
are equivalence classes of holomorphic operator pairs 

(Ko(X) Ki(X)) T : K! + -> Tio®Hi, X G C+; (N Q (X) Ni(X)) T : K!_ -> Ti Q ®Tii, X G C_ 
with the block-matrix representations 

K ^ = (S(A)) : r + - ^ ® = (nI{x)) ■ K - H - 

Similarly let /C + and /C_ be Hilbert spaces and let 
(2.12) 

r + (X) = {(C (X),Ci(X));IC + }, XeC + ; r_(A) = {(D (X), Di(X)); /C_}, A G C_ 
be equivalence classes of holomorphic operator pairs 

(C (A) Ci(A)):W ©Wi->/C+, AGC+; (D (X) Di(X)) : W © Wi -> /C_, A G C_ 
with the block-matrix representations 

C (A) = (Coi(A) C 02 (A)) : Wi©W 2 -> /C+, D (A) = (D i(A) £> 02 (A)) : Hi©^ 2 -> /C_. 
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Definition 2.5. 1) A collection r = {t + ,t_} of two holomorphic operator pairs (2.11) 
(or more precisely of two equivalence classes of operator pairs (2.11)) belongs to the 
Nevanlinna type class R(Ti. ,Tli) if it obeys the relations 

(2.13) 2Im(K* 1 (X)K 1 (\))-K* 02 (X)K 02 (X) > 0, G p(Ki(X) + iK 01 (X)), X G C + 

(2.14) 2Im(N* 1 (X)N 1 (X)) - N* 2 (X)N 02 (X) < 0, G p(N 1 (X) — iN (X)), A G C_ 

(2.15) 7V*(A)Xoi(A) - A^A^A) +*Aft(A)K 02 (A) = 0, AG C+. 

2) A collection r = {t + ,t_} of two holomorphic operator pairs (2.12) is referred to 
the class R(Ho,Hi) if 

(2.16) 2Im(C 1 (X)C* 01 (X)) + C 02 (X)C* 02 (X)>0, G p(C (A) — iC 1 (X)Pi), A G C + 

(2.17) 2Im(D 1 (X)D* 01 (X)) + D 02 (X)D* 2 (X) < 0, G p(D 01 (X) + iD^X)), A G C_ 

(2.18) C^A^A) - C„i(A)£>;(A) + iO^A^A) = 0, AG C+. 

Note that the above definition of the class R(Ho,Hi) slightly differs from that con- 
tained in [21]. At the same time by methods similar to [21], Proposition 4.3 one can prove 
that (2.11) defines a pair r = {r+,r_} G R(H ,Hi) if and only if r±(-) : C± -»• C(W ,Wi) 
are holomorphic functions obeying — r + (A) G Ac(Ti,o,Ti,i), X G C + and — r_(A) = 
(— r + (A)) x , A G C_. This and [21], Proposition 3.1, 4) imply that collections (2.11) 
and (2.12) are associated by K± = K.L and 

(2.19) C„(A) = (iV*(A) *iV * 2 (A)) ■H 1 ®H 2 ^ K!_, d(A) = -Aft (A), A g C + 

(2.20) D (A) = (AT* (A) zK * 2 (A)) ■.H 1 ®n 2 ^ K' + , £>i(A) = -^(A), A G C_ 

define the same functions t±(-). Hence the relations (2.19) and (2.20) give a bijective 
correspondence between collections (2.11) and (2.12), which makes it possible to identify 
such collections (connected by (2.19) and (2.20)). 

One can prove that for a pair r = {t + ,t_} G R(Ho,H\) the following statements are 
equivalent: 

(a) 2Im(K* 1 (X)K 1 (X)) - K* 2 {X)K 02 (X) = and G p(#i(A) - itfo(A)) for some 
A G C + ; 

(b) 2/m(AT* 1 (A)A^ 1 (A)) - A"* 2 (A)A 02 (A) = and G p(Aq(A) + iiV i(A)) for some 
A G C_; 

(c) 2/m(Ci(A)C * 1 (A)) + C 2(A)Q 2 (A) = and G p(C i(A)+iCi(A)) for some A G C+; 

(d) 2Im(D 1 (X)D* 1 (X)) + D 02 (A)^ 2 (A) = and G p(D (A) - iDi(A)Pi) for some 
A G C_; 

(e) the relations (a) - (d) hold for all A in the corresponding half-planes. 

Definition 2.6. A collection r = {r + , r_} G R(Tio, Tii) is referred to the class R (7io, ^i) 
if it obeys at least one (and hence each) of the conditions (a) - (e). 

It is easy to see that a collection r = {r + , r_} of two holomorphic operator pairs (2.11) 
(or, equivalently, (2.12)) belongs to the class R°(TCo, Hi) if and only if r+(A) = t_(A) = 9, 
where 9 G C(W ,Wi) and (-fl) x = -0. Therefore a pair r = {r+,r_} G R {H ,Hi) 
admits the constant-valued representation 

r±(A) = {K , ^i; /C'} = {(Co, Ci); /C}(= G C(W , Wi)), A G C±. 
Moreover the set R°(Tio,Ti,i) is not empty if and only if dim7io = dim7Yi. 

Remark 2.7. 1) Let (2.11) be a representation of a pair r = {r + ,r_} G R(7io,Tii). Then 
dim/C' + = dim7Yi, dim/C'„ = dim7i and, therefore, Hilbert spaces K! + and /C'_ can be 
chosen equal only in the case dim7ii = dim7Yo- This explains the presence of different 
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spaces KJ + and K!_ in (2.11) (respectively /C+ and /C_ in (2.12)). Observe also that in 
the case /C+ = /C_ =: /C a collection {r + (A), r_(A)} of two operator pairs (2.12) can be 
considered as the unique holomorphic operator pair defined on C + U C_. 

2) In the case 7i\ = Tio —: 1~L the class R(7i) :— R(Ti,7i) coincides with the well 
known class of Nevanlinna functions (holomorphic operator pairs) with values in C(7i) 
(see for instance [18, 8]). More precisely, the equality 



r(A) 



r + (A), XeC, 
r_(A), AgC_ 



gives a bijective correspondence between all collections r = {t + ,t_} G i?(7i) and all 
Nevanlinna functions r(-) : C + U C_ — > C(7i). 

Letting in (2.12) /C+ = /C_ =: /C and Cj(A) := Dj(A), A G C_, j G {0,1} one can 
represent a Nevanlinna function r(-) G R(TC) as 

(2.21) r(A) = {(C (A), d(A)); /C}, A G C + U C. 

Formula (2.21) gives a bijective correspondence between all functions r(-) G R(Ti) and all 
equivalence classes of holomorphic operator pairs (Co (A) Ci(A)) : © — > /C obeying 

JmA • Jm(Ci(A)C , *(A)) > 0, G p(C (A) - i sgn(/mA)C7 1 (A)), 

Ci(A)C3(A) - C (A)C*(A) =0, A G C+ U C. 

(these relations follows from (2.16)-(2.18)). Similarly formulas (2.11) and (2.13)-(2.15) 
imply that the equality 

(2.22) r(A) = {K (A),iri(A);/C'}, A G C+ U C_ 

gives a bijective correspondence between all functions r(-) G i?(7^) and all equivalence 
classes of holomorphic operator pairs (K (\) K 1 (X)) T : KJ — > 7i © obeying 

/mA-/m(if *(A)i{i(A)) > 0, G p(K 1 (X) + isgn(Im\)K (\)), 

Kl(X)K (X) - K^K^X) = 0, A G C+ U C_. 

Moreover in view of (2.19) and (2.20) the connection between representations (2.21) and 

(2.22) of the same function r(-) G R{7i) is given by 

C (A) = K*(X), d(A) = -ifo(A), A G C + U C_. 

In the similar way one can reformulate the conditions (a)-(e) of Definition 2.6 for the 
class R (H) := R°(H,H). In particular, a function r(-) : C + U C_ — > C(7i) belongs to 
the class if and only if r(A) = 6 = 9*(e C(H)), X G C + U C_. 

2.3. Boundary triplets and Weyl functions. Let A be a closed densely defined 
symmetric operator in Sj. In what follows we will use the following notations: 
n±(A) := dim Vl\(A) (A G C±) are deficiency indices of A; 

Ext A is the set of all proper extensions of A, i.e., the set of all closed operators A in 
S) such that Ac Ac A*. 

Let 7io be a Hilbert space, let 7i\ be a subspace in T~Cq and let Ti.2 '■— TioQT~ti- Denote 
by Pj the orthoprojector in 7Y onto Hj, j G {1, 2}. 

Definition 2.8. [22] A collection II = {7i © T~ti, To, ri}, where Tj are linear mappings 
from V(A*) to Tij (j G {0, 1}), is called a D-boundary triplet (or briefly D-triplet) for 
A*, if T = (r Ti) T : V(A*) -> 7i © ^i is a surjective linear mapping onto 7i © ^i 
and the following Green's identity holds 

(2.23) (A*f,g) - (f,A*g) = (TJ^g) - (r /, T l9 ) + i(P 2 T f, P 2 T g), f,g G V(A*). 



10 VADIM MOGILEVSKII 

As was shown in [22] a D-triplet {H Q)Hi,T , Ti} for A* obeys the relation dim7ii = 
n-{A) < n + (A) = dim7Y - Moreover the equalities 

(2.24) V(A ) := Kerr = {/ G V(A*) : r / = 0}, A = A* \ V(A ) 

define a maximal symmetric extension A G Pxt^ with n_(A ) = 0. 

It turns out that for every A G C + [z G C_) the map T [ W\(A) (PiF \ %,{A)) is 
an isomorphism. This makes it possible to introduce the operator functions (7-fields) 
7+(-) : C+ -> [Wo, 5], 7-(0 : C_ -> and the Weyl functions M+(-) : C+ -> 

[H Q ,Hi\, M_(.):C_->[Wi,W ]by 

(2.25) 7+ (A) = (r r ^(A))" 1 , A G C + ; 7 _(z) = (P^o [ ^l z (A))~\ z e C_, 

(2.26) r\ r on A (^) = M + (A)r r m A (A), a g c + , 

(2.27) (r\ + tP 2 r ) \ vx z (A) = M_(z)P!r r ^(A), z g c_. 

According to [22] all functions 7 ± and M± are holomorphic on their domains and 
M*(A) = M_(A), A G C+. Moreover the following relation holds 

(2.28) MM - M* + (X)P 1 + iP 2 = (fx - A) 7 ;(A) 7+ (/i), /i, A G C+. 

Lemma 2.9. Assume £/ia£ {7i © Hi, T , Ti} is a D-triplet for A* , 9 = {(C , Ci); /C} G 
C{Hq,Hi) is an operator pair (2.7), # x = {(Co x , Ci x );/C x } G C{Hq,Hi) is the x-adjoint 
pair and Cu, Co* are operators (2.10). Then 

(2.29) (C T + C 1 T 1 ) 1+ (X) = C + C 1 M + (X), A G C+ 

(2.30) (C , oxro + C 1>< r 1 )7_(z) = C 1 , + Co lt M_(z), 2 6C_. 
Proo/. It follows from (2.25) - (2.27) that 

(2.31) r 01+ (\) = i Ho , r l7+ (A) = M+(A), AGC+ 

(2.32) p 1 r 7-W = /w 1 , P 2 r o7 _(z) = - ? p 2 m_(z), r l7 _(z) = p 1 M_(z), zeL. 

The equality (2.29) is immediate from (2.31). Moreover (2.32) yields 

(c 0x r + c lx r 1 ) 7 _(z) = c 0x p 1 r o7 _(z) + c 0x p 2 r o7 _(,z) + c lx r l7 _(z) = 

C 0x rW 1 + (C lx P 1 -zCo x P 2 )M_(z) = C 1 , + C *M_(^, zgL. 

□ 

The combination of Proposition 4.1 and Theorem 4.2 from [22] gives the following 
theorem. 

Theorem 2.10. Suppose that IT = {H ®Hi, T , I\} is a D -triplet for A* , 9 = {(C ,Ci);K,} 
G C(Ho,Hi) is an operator pair and A G Pxt^ is an extension defined by the abstract 
boundary condition 

(2.33) P(I) = {/ G V(A*) : C T f + C^/ = 0}, I = A* \ V(A) 

Then A G p(A) fl C + •<=>- G p(Co + CiM + (X)) and the following Krein type formula 
for canonical resolvents holds 

(2.34) (2- A)- 1 = (Ao - A)- 1 - 7+ (A)(C + C 1 M + (A))- 1 C l7 l(A), A G p(A) n C+. 

Next recall the following definition. 

Definition 2.11. An operator function IR(A) : C + U C_ — > is called a generalized 
resolvent of a symmetric operator A, if there exist a Hilbert space D f) and a self- 
adjoint operator A in # such that Ac A and R(A) = Pq(A - A) _1 |£), A G C + U C_. 

In the following theorem the description of all generalized resolvents is given in terms 
of abstract boundary conditions. 
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Theorem 2.12. [22] Let U = {H © H u T , I\} be D '-triplet for A*. Then the relations 
(2.35) 

V(A(X)) - { {f E V{A ^ ■ CoWTof ~ Cl(A)Fl/ = ° } ' XE C+ A(X) G Ext. 
"(AW) -\{fe V(A*) : D (X)r f - D 1 (X)T 1 f = 0}, A G C_ ' A[A) G 

(2.36) R(A) = (A(X) - A) -1 , X G C+ U C_ 

establish a bijective correspondence between all generalized resolvents R(A) o/ A and all 
collections of holomorphic operator pairs r = {t + ,t_} G R(Ho,Tli) defined by (2.12). 
Moreover R(A) is a canonical resolvent if and only if r G R°(Ho,'Hi) ■ 

Remark 2.13. If a -D-triplet II = {7Y © Wi,To, Ti} satisfies the relation 7i = : = 
A = Aq), then it is a boundary triplet. More precisely this means that the 
collection II = {7i,T ,Ti} is a boundary triplet (boundary value space) for A* in the 
sense of [14]. In this case the relations 

(2.37) 7 (A) = (r [ ^a(A))- 1 , I\ \ Vl x (A) = M(A)r \ m x (A), X G p(A ) 

define the operator function (7-field) 7(-) : p(Aq) — > and the Weyl function M(-) : 

p{Ao) — > [7i] [6] associated with operator functions (2.25)-(2.27) via 7(A) = 7±(A) and 
M(A) = M±(A), A G C±. Observe also that in the case n+(A) = n-(A) formulas 
similar to (2.35), (2.36) were originally obtained in [4] on the basis of Shtraus formula for 
resolvents [28] (see also [6]). 



3. Differential operators and decomposing boundary triplets 

3.1. Differential operators. Let A = [0, b) (b < 00) be an interval on the real axis (in 
the case b < 00 the point b may or may not belong to A), let if be a separable Hilbert 
space with dimiJ < 00 and let 

(3.1) l[y] = l H [y] = X>l) fc ((Pn- fc 2/ W ) W - ft^W^ + (<M V^)^) + PnV, 

k=l 

be a differential expression of an even order In with smooth enough operator-valued 
coefficients Pk('),Qk(') '■ A — > [H] such that Pk{t) = p%{t) and G p(po(t)) for all t G A 
and = t n. Denote by y'^(-), k = -r 2n the quasi-derivatives of a vector-function 
y(-) : A — > H, corresponding to the expression (3.1). Moreover for every operator 
function Y(-) : A — > [/C, H] (JC is a Hilbert space) introduce quasi-derivatives Y^(-) by 
the same formulas as y^ (see [23, 24]). 

Let T>(1) be the set of all functions y(-) such that y'^(-), k = 4- (2n — 2) has a 
continuous derivative on A and |/ 2ra-1 l is absolutely continuous on A. Furthermore for a 
given Hilbert space /C denote by £>/c(/) the set of all operator-functions Y(-) with values 
in [/C, H] such that l^ fc '(-), = 4- (2n — 1) has a continuous derivative on A. Clearly 
for every y G V(l) and V G X>a:(0 the functions y^(-) : A — > A; = 4- (2n — 1) and 
yM(.) : A — > [/C, if], fc = 2ra are continuous on A, the function y^(t)(e if) is 
defined almost everywhere on A and 

l[y] = yW(t), yeV(l); l[Y]=Y^\t), Y eV K (l). 

This makes it possible to introduce the vector functions y^\-) : A — > ff n , 7 G {1,2} 
and : A ^ H n ® H n , 



(3.2) y W(t) := {y^^lLiCe ?/ (2) W := {y [2n ~ k] (*)}3U(e # n )> 

(3.3) y(t) = y (2) (*)}(e © # n ), * G A, 
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which correspond to every y G V(l). Similarly with each Y G T>)c(l) we associate the 
operator-functions y (*')(•) : A — > [/C, # n ] and ?(•) : A -> [/C, # n © # n ] given by 

yW(t) = (Y(t) Y [1] {t) ... Y [n - 1] (t)) T , Y {2 \t) = {Y [2n - 1] (t) Y [2n - 2 \t) ... Y [n] {t)) T , 

Y(t) = (Y (1 \t) Y (2 \t)) T : K -> H n ®H n , t G A. 

Next for a given A G C consider the equation 

(3.4) %]-Ay = 0. 

As is known this equation has the unique vector solution y G T>(1) (operator solution 
y G T>)c(l)) with the given initial data y j0 = y^(0) (respectively, Y j0 = Y^(0)), j G 
{1,2}. We distinguish the two "canonical" operator solutions c(-,A) and s(-,A) : A — > 
[i/ n , iL], A G C of the equation (3.4) with the initial data 

(3.5) c« (0, A) = I Hn , c< 2 > (0, A) = 0, (0, A) = 0, s (2) (0, A) = I H n , AG C. 
Clearly the equality 

(3.6) Y (t,X) := (c(t,X) s(t,X)) : H n ® H n -> AgC 

defines the operator solution of (3.4) with y (0, A) = Ih^^h^- Moreover every operator 
solution y(-) G T>/c(l) of (3.4) is connected with Y (-, A) by 

(3.7) Y(t)=Y (t,X)Y(0). 

The following lemma is well known (see for instance [23, 17]). 

Lemma 3.1. Let f G L 1 ^ oc (A; H) and let Y(-) : A — > [/C, i/] fre an operator solution of 
(3.4). iVeai assume that an absolutely continuous function C(-) : A — > /C satisfies 

(3.8) y(x)C"(x) = /(x) (mod /x), 

where the vector function /(•) : A — > H n ®H n is given by f(x) = {0, . . . , 0, —f(x), 0, . . . , 0} 

n n—1 

and /it is £/ie Lebesgue measure on A. T/ien £/ie vector function y(x):—Y(x)C(x) belongs 
to V{1) and obeys the relations 

(3.9) %]-Ay = /, y(x) = Y(x)C(x). 

In what follows we denote by $)(= L 2 (A; H)) the Hilbert space of all measurable 
functions /(•) : A — > H such that f^ \ \f(t)\\ 2 dt < oo. Moreover L' 2 [IC, H] stands for the 
set of all operator-functions Y(-) : A — > [/C, H] such that Y(t)h G for all /i G /C. 

It is known [23, 24] that the expression (3.1) generate the maximal operator L in 
$), defined on the domain V = V(L) := {y G V(l) f] S) : l[y\ G f)} by the equality 
Ly = l[y], y G V. Moreover the Lagrange's identity 

(3.10) (Ly, z)si - (y, Lz)z = [y, z]{b) - [y, z](0), y,zeV 
holds with 

[y,z](t) = ( V U(t),zW(t)) Hn - {yW(t),zW(t))H», [y,z](b) = \im\y,z](t). 

tjb 

The minimal operator L is defined as a restriction of L onto the domain D = T>(L ) 
of all functions y G T> such that y(0) = and [y, z](b) = for all z G T>. As is known 
[23, 24] L is a closed densely defined symmetric operator in fj and Lq = L. Moreover 
the subspace Ot^Lo) (= Ker(L — A)) is the set of all solutions of (3.4) belonging to $). 
Let 9 = 9* G C(H n ) and let L<? be a symmetric extension of L with the domain 

(3.11) V{L B ) = {yeV: y(0) G and [y, z](6) = 0, z G P}. 
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As was shown in [20] deficiency indices n±(Lg) of an operator L e do not depend on 
9(= 9*). This makes it possible to introduce the following definition. 

Definition 3.2. [20] The numbers n b ± := n±{L e ) (9 = 9* G C{H n )) are called deficiency 
indices of the differential expression l[y] at the right end b of the interval A. 

3.2. Decomposing boundary triplets. Assume that H[ is a subspace in a Hilbert 
space H' , H! 2 :— H' © Ti'u Y' : V — > H' and Y[ : V — > H[ are linear maps and P- is the 
orthoprojector in H' onto Tip j G {1,2}. Moreover let H = H n ®H' , Hi = H n © H[ 
and let 1^ : T> — > 7ij, j G {0, 1} be linear maps given by 

(3.12) r y^ 2 )(o),i>}(e r 1 y = {-y^(o),r' 1 y}(eH n ®n' 1 ), ye v. 

Definition 3.3. [20] A collection II = {Ho ® Ti.i,Y ,Yi}, where T and Y± are linear 
maps (3.12), is said to be a decomposing .D-triplet for L if the map T' = (Y' Y'^ : 
T> — > 7^o © 7^ is surjective and the following identity holds 

(3.13) [ y ,z](b) = (r' iy ,r' z) - (r>,r» + i(p^,p^), ^gd. 

In the case 7i' = ?{[ =: H! ( •<=>- 7i = Hi =: 7i) a decomposing TJ-triplet 
II = {H^Yq^Yi} is called a decomposing boundary triplet for L. For such a triplet 
the identity (3.13) takes the form 

(3.14) [y,z](b) = (r J 1 y,r' z)-(r' y,r J 1 z), y,zev. 

As was shown in [20], Lemma 3.4 a decomposing D-triplet (a decomposing boundary 
triplet) for L is a TJ-triplet (a boundary triplet) in the sense of Definition 2.8 and Remark 
2.13. Moreover a decomposing D-triplet (boundary triplet) for L exists if and only if 
n b - < n b+ (respectively, n b _ = n b+ ), in which case 

(3.15) dim 7-^ = n b ^ < n b+ = dimH' (respectively, n b - = n b+ = dim7i'). 

Therefore in the sequel we suppose (without loss of generality) that n b _ < n b+ and, 
consequently, n_(L ) < n +(L ). 

Theorem 3.4. [20] Let Yl = {Hq®Hi,T ,Ti} be a decomposing D -triplet (3.12) and let 

(3.16) M +W= (™[f X) A eC+ , 

(3.17) M_ W = ( ™W , JJ- W) : fl- ® HI fl- ® Hi, * e C, 

be the block-matrix representations of the Weyl functions (2.26), (2.27) for IT. Then: 
1) the maximal symmetric extension A G Exti (see (2.24) ^ nas £ne domain 

(3.18) ©(A)) = e © : y (2) (o) = o, r> = o} ; 

2) /or ever?/ A G C + U C_ there exists the unique operator function vo(-, A) G L' 2 [P~ n , P], 
satisfying the equation (3.4) and tae boundary conditions 

(3. 19) (0, A) = I H n, A G C+ U C_ 

(3.20) Y' (v (t, \)h) = 0, AG C+; P[T' (v (t, z)h) = 0, z G C_, k P n . 

Moreover for every A G C + (z G C_) tnere exists the unique operator function u + (-, A) G 
L 2 [7Yq,P] («_(•, z) G ^[H'l) H])> satisfying (3.4) and iae boundary conditions 

(3.21) n Jh 2) (0,A)=0, r' ( u+ (t,A)^ ) ) = ^, A G C+, ^ G H' ; 

(3.22) nL 2) (0, 2) = 0, P[Y' (u_(t, z)h[) = h[, z G C_, h[ G H[. 
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3) let Z + (-,X) G L' 2 [H ,H] and Z_(-,z) G L 2 [Hi,H] be operator solutions of (3.4) 
defined by the block-matrix representations 

(3.23) Z+(t,X) = (v (t,X) u+(t,X)) : H n @H' Q -> H, X G C + , 

(3.24) = MM) u_(M)) : H n ®H[ -> if, £ G C_. 
TTien 

and tae ^-fields (2.25) for II o&ey ine relations 

(3.27) ( 7+ (A)/> )(t) = Z + (t,A)/i , AgC+, h E H 

(3.28) (7_(2)fti)(t) = Z_[$,z)h x , ^gC_, /iiGWi 

TTws implies that Z + (-, X) and Z_(-,X) are fundamental solutions of (3.4) with holomor- 
phic quasi-derivatives Z+\t, •) and Z^3(t, •), k = -f- (2n — 1) (see Definition 4.3). 

4) the block-matrix representations (3.16) and (3.17) generate the uniformly strict 
Nevanlinna operator- function m(-) : C + UC_ — > [if n ] f £/iis means that I mX- 1 m (ra(A)) > 
0, G p(fm (m(A))) and m*(A) = m(A), A G C+ U C_j. 

Definition 3.5. [20] The operator function m(-) defined in the statement 4) of Theorem 
3.4 is called an m-function of the operator L , corresponding to the extension A . 

In the following corollary the statements of Theorem 3.4 are reformulated for the case 
of a decomposing boundary triplet. 

Corollary 3.6. Let II = {T-i,T ,Ti} be a decomposing boundary triplet (3.12) for L 
(that is H' = W 1 =: T~C), let A (— L \ KerT ) be the extension (2.24) and let 

(3.29) M(A) = ( ™W : H" ® W fl- e W, A e p(A ) 

6e the block-matrix representation of the corresponding Weyl function (2.37). Then: 

1) Aq is a self adjoint extension with the domain (3.18); 

2) for every X G p(A ) there exist the unique pair of operator functions v (-,X) G 
L' 2 [H n ,H] anduo(-,X) G L' 2 [H',H] satisfying (3.4)and the boundary conditions 

v { *\o,X)=I H n, T' (v (t,X)h)=0, heH n , Xep(A ) 
4 2) (0, A) = 0, r' (u (t, X)h') = h', h! eW, Ag P {A ) 

3) let Z (-, A) G L 2 [H, H] be an operator solution of (3.4) defined by 

(3.30) Z (t,X) = (v (t,X) u {t,X)) : H n ®W -> if , X G p(A ) 
Then 



^< 2, (0,A) v£\0,\)) V 
and tne corresponding j-field (2.37) o&ey (7(A) /&)(£) = ^o(^ A) to, h &Ti, AG p(A))- 
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4. Fundamental solutions and resolvents of differential operators 

4.1. Fundamental solutions and spectra of proper extensions. Let II = {Ho © 

Wi,r ,ri} be a decomposing D-triplet (3.12) for L, let 9 = {(C , d); /C} G C{H ,Hi) 
be an operator pair and let 6> x = {(C 0x , Cix); A^x} € C(Ho,Hi) be a x -adjoint operator 
pair. Moreover assume that 

(4.1) C = (C 2 C ) :H n ®H' ^)C, d = (-c\ C() : tf" © H[ -> /C, 

(4.2) C 0x = (C 2x Co x ) : i? n © 7i[, — > /C x , Cix = (-Cix C' lx ) : H n ®H[ ^ IC X 

are the block-matrix representations of the operators Cj and C jx , j G {0, 1}. 

In the next theorem the set of all proper extensions of the minimal operator L is 
described in terms of boundary conditions. 

Theorem 4.1. [20] Let II = {Ho © Hi, V , Ti} 6e a decomposing D-triplet (3.12) /or L. 
T/ien t/ie equalities (the boundary conditions) 

(4.3) = {y G P : C7i?/ (1) (0) + C 2 y^(0) + C^y + C[Y' iy = 0}, 1 = L \ V{A) 

establish a bijective correspondence between all proper extensions A G Ext Lo and all 
operator pairs 9 = {(C ,Ci);/C} G C(Ho,Hi) defined by (4.1). Moreover the adjoint A* 
to the extension (4.3) has the domain 

(4.4) V(A*) = {yeV: (7 1X ?/ (1) (0) + C 2x y (2) (0) + C' 0x T' y + C7( x r' iy = 0} 
where the operators (7 lx , C 2x , Cq x and C' lx are defined by (4.2) 

Remark 4.2. It is clear that the boundary conditions (4.3) can be written as 

(4.5) V{A) = {yeV: C T y + C^y = 0}. 
Definition 4.3. Let A G C and let K! be a Hilbert space. An operator function 

(4.6) Z(.,A):A^[/C',#] 

will be called a fundamental solution of the equation (3.4) if: (i) Z(-,X) is an operator 
solution of (3.4); (ii) Z(-, A) G L' 2 [/C', if] (and, hence, A)/i' G m A (L ) for all h! G /C'); 
(iii) for every y G ^(^ o) there is the unique hi G K! such that y(t) = Z(t, X)h'. 

Clearly, an operator function (4.6) is a fundamental solution of the equation (3.4) if 
and only if it is an operator solution of (3.4) and the equality y = Z(t,X)h' gives a 
bijective correspondence between all functions y G 9Ta(£o) and all h! G KJ . 

Lemma 4.4. 1) For every operator Z G [/C', VI\{Lq)\ the relation 

(4.7) Z{t,X)h' = {Zh'){t), h'eK! 

define an operator solution Z(-,X) G L' 2 [)C',H] of (3.4). Conversely for each such a 
solution there exists an operator Z G [K.',yi\(Lo)] such that (4.7) holds. 

2) The equality (4.7) establishes a bijective correspondence between all fundamental 
solutions (4.6) of the equality (3.4) and all isomorphisms Z G [)C, 9Ia(£ o)] ■ 

3) Let Z(-, A) G L' 2 [)C', H] be an operator solution of (3.4) and let Z G [fC, 9Ia(A))] be 
the corresponding operator (4.7) considered as acting to the Hilbert space S). Then 

(4.8) Z*f = / Z*(t, X)f(t) dt := hm / Z*(t, X)f(t) dt, f = f(t) G f). 

V^b 

Proof. 1) Let 5\ : yi\(L ) — > i? n © be a linear map given by 5\y = y(0), y G ^(-^o)- 
As is known [24, 26] the operator 5 X is bounded, that is 5 X G [yi\(L ), H n © H n \. 
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Next for a given Z G [JC' , 9Ta(A))] consider the operator solution Z(-, A) : A — > [/C', if] 
of the equation (3.4) with the initial data Z(0, A) = 5 A -Z. It is clear that for every fixed 
h! G JC' the vector function 

(4.9) y = y(t,ti):=(Zti)(t) 

is a solution of (3.4) with y(0) = 8\Zh! = Z(0,X)h'. Therefore y = Z(t,X)h' and by 

(4.9) the introduced operator function Z(-,X) satisfies (4.7). Hence Z(-,X) G L' 2 [JC',H]. 
Conversely, let Z(-, A) G f ^[^-'j -^1 be an operator solution of (3.4). Then the equality 

(4.7) defines a linear map Z : K! — > 9Ta(A)) obeying c^Z = Z(0, A) with bounded 
operators 5\ and Z(0, A). This and the equality Ker<5 A = {0} imply that the operator Z 
is closed and, consequently, bounded. 
The statement 2) is immediate from 1). 

3) The proof of (4.8) is similar to that of the formula (3.70) in [20] □ 
The following theorem is immediate from Lemma 4.4, 2). 
Theorem 4.5. 1) For every A G C and for every Hilbert space JC' with 

(4.10) dim/C' = dim91 A (L ) 

there exists a fundamental solution Z(-,X) : A — > [JC',H] of the equation (3.4). Con- 
versely, for every fundamental solution (4.6) the equality (4.10) holds. 

2) Let Z (-, A) : A — > [JC', if] be a fundamental solution of (3.4). Then the equality 

Z(t,X) = Z (t,X)X 

gives a bijective correspondence between all fundamental solutions (4.6) and all bounded 
isomorphisms X G [JC 1 ]. 

In the following theorem we show that there exist fundamental solutions Z(t, A) of 
(3.4) with holomorphic quasi-derivatives of all orders. 

Theorem 4.6. Let A be a proper extension of L with nonempty resolvent set p(A). 
Then there exists a family of fundamental solutions Z(-,X) : A — > [fC',H], X G p(A) 
of the equation (3.4) such that for every fixed t G A all quasi-derivatives Z^(t, •), k = 
-i- (2n — 1) are holomorphic on p(A). 

Proof. Denote by T> + the Hilbert space of all functions y ET> with the inner product 

(v,z)+ = (y,z)sj + (Ly,Lz)sj, y,zeV + 

and let 5 : T> + — > H n © H n be a linear map given by 5y = y(0), y G T> + . Since the 
norms || • ||+ and || • ||^ are equivalent on a subspace 9Ia(A))> the operator 8 \ D^a(^o)(= 
5\) is bounded. Moreover 5 \ V = by definition of V . This and the orthogonal 
decomposition 

V + = V © VU(L ) © 9Li(Lo) 
imply that 5g [D+,iJ n © // n ]^ 

Next assume that Ao G p(A) and 2 is an isomorphism of a Hilbert space JC' onto 
9^a ( ,(^o). Since the resolvent (A — X)' 1 (A G p(A)) is a holomorphic operator function 
with values in [^,P + ], the equality 

(4.11) Z(X) := Z + (A - A )(2 - A)- 1 ^, A G p(2) 

defines a holomorphic operator function Z(-) : p(A) — > [/C / ,'D + ]. Moreover one can 

easily verify that Z(A)/C' = ^a(^o) and KerZ(A) = {0}. Therefore by Lemma4.4, 2) 
the relation 

(4.12) Z(t, X)h' := (Z(X)h')(t), h' G JC' , teA 
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defines a family of fundamental solutions of the equation (3.4) with Z(0, A) = 5Z(X). 
Hence the operator function Z(0, ■) is holomorphic on p(A) and, consequently, so is the 
function Z(t, •) for every fixed t G A. □ 

Let IT = {Hq © 7ii,r ,r!} be a decomposing D-triplet (3.12) for L and let Z(-, A) : 
A — > [/C', if] (A G C) be a fundamental solution of the equation (3.4). For every operator 
pair 6 = {(C ,Ci);/C} G C(H ,Hi) introduce the operator T G [/C', /C] by 

(4.13) T = (C r + CiTi)Z, 

where Z G [/C', ^(Lq)] is the corresponding isomorphism (4.7) (see Lemma 4.4, 2)). 
Using the block-matrix representation (4.1) one rewrites (4.13) as 

(4.14) Tti = (CiZ«(0, A) + C 2 Z^(0, \))ti + (C' T' + C'^V^Z^, \)ti), ti G K! . 

In the following theorem we describe the spectrum of a proper extension A G Exti in 
terms of boundary conditions and a fundamental solution Z(-, A). 

Theorem 4.7. Let under the above suppositions A G Exti be a proper extension given 
by the boundary conditions (4.3). Then for every A G p(L ) the following holds 

(4.15) A G p(A) ^ G p(T), A G (7,(1) « G ^(T), j G {p,c,r} 

(4.16) Xep(A) OGp(T), TZ(A — A) = TZ(A — A) TZ{T)=TZ{T) 

Proof. By using Proposition 3.17 in [19] one can derive the relations (4.15) - (??) with 
the operator (C r + C^) \ OT A (L ) in place of T. This and bijectivity of Z in (4.13) 
yield the statement of the theorem. □ 

Remark 4.8. In [25, 26] a fundamental solution of the equation (3.4) is defined as an 
operator function (4.6) obeying the conditions (i)-(iii) of Definition 4.3 and, in addition, a 
selfadjoint boundary condition at the point b (which exists only in the case n& + = n^ ). In 
this connection note that statements of Theorems 4.6 and 4.7 complement and generalize 
similar results obtained in [25, 26]. 

4.2. Resolvents of proper extensions of the minimal operator. Let as before 
n = {H © Wi,r ,ri} be a decomposing D-triplet (3.12) for L, let 9 = {(C , d); K} 
G C(7io,Ti,i) be an operator pair (4.1) and let A G Ext^ be the corresponding extension 

(4.3). Assume that A G p{A) and let Z(-, A) : A — > [/C', H] be a fundamental solution of 
the equation (3.4) (such a solution exists in view of Theorem 4.5). It follows from (4.15) 
that the corresponding operator T G [/C',/C] (see (4.13)) is invertible. This allows us to 
introduce the operator function Yg(-,X) : A — > [K.',H] as the operator solution of the 
equation l[y] — Xy — with the initial data 

(4.17) Yg (1) (0, A) = -C;T~ u , Y e {2) {0,X) = C*T~ U . 

Next assume that 9 X = {(C 0x , C'lx); ^ x } G C(Ho,Hi) is a x-adjoint operator pair (4.2). 
Then the adjoint extension A* is defined by (4.4) and A G p(A*). Let Z(-, A) : A ->• 
[/C' x ,if] be a fundamental solution of the equation Z[y] — Ay = and let T x G [/C' x ,/C x ] 
be the operator given by 

(4.18) T x ti = (C7 lx Z«(0, A)+C7 2x Z( 2 )(0, X))ti +(C' 0x T +C[ x T' l )(Z(t, X)h'), h' G /C' x . 

Then in view of Theorem 4.7 G p(T x ), which makes it possible to define the operator 
function Y e x(-, X) : A — > [/C x , if] as the operator solution of (3.4) with the initial data 

(4.19) y£>(o, A) = -c^t- 1 *, y e ( x 2) (o, A) = c^r- 1 *. 
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One can easily verify that for a given fundamental solution Z(-, A) (Z(-, A)) the operator 
function Yg(-, A) (Ygx (■, A)) is uniquely defined by 9, i.e., it does not depend on the choice 
of the equivalent representation 9 = {(C , Ci); /C} (respectively, 9 X = {(C 0x , Cix); ^C x }). 

Definition 4.9. The operator function G$(-, •, A) : A x A — > [if], given by 

(4.20) (?,(*,*, A) 4^;A)WA), *>t A £ p(A) 

will be called the Green function, corresponding to an operator pair 9 £ C(T~Cq,T~Ii). 

It is easily seen that for a given operator pair # the Green function (4.20) does not 
depend on the choice of fundamental solutions Z(-, A) and Z(-, A). 

Theorem 4.10. Suppose that II = {Ho (BHi,T ,Ti} is a decomposing D-triplet (3.12) 
for L, 9 = {(C ,Ci);/C} £ C(Ho,Hi) is the operator pair (4.1), A £ Ext L{) is the 
corresponding extension (4.3), A £ p(A) and Go(x,t,\) is the Green function (4.20). 
Then the resolvent (A — A) -1 £ [fi] is the integral operator, given by 

(4.21) ((A - X)~ 1 f)(x) = / G e (x, t, X)f(t) dt := lim J G e (x, t, \)f(t) dt, f = /(•) £ fi. 

Vlb o 

Proof. Stepl. Let fib be the set of all functions / £ fi such that f(t) = on some interval 
(rj, b) C A (depending on /). First we show that 

(4.22) ((A - \r l f)(x) = / G (x, t, X)f(t) dt, f = /(•) £ fi b , X £ C+, 

o 

where A is the symmetric extension (3.18) and the operator kernel Gq(x, t, A) is 

(ao*\ n + \\ \-vo{x,\)(f{t,>), x>t 

(4.23) G {x,t,X) = < - , A£C+UC_. 

I — c(x, X) Vo(t, A), x<t 
To prove (4.22) it is sufficient to show that for every / = f(t) £ fib the function 

(4.24) y = y(x, A) := / G (x, t, X)f(t) dt, A £ C + 

o 

belongs to D(Aq) and obeys the equality l[y] — Xy = f. 
It follows from (4.24) and (4.23) that 

(4.25) y = y(x,\) = c(x,\)C 1 (x)+v (x,\)C 2 (x)=Y v (x,\)C(x), A £ C + 
where 

(4.26) C 1 (x) = -}v* (t,X)f(t)dt, C 2 (x) = -Jc*(t,X)f(t)dt, 

x 

(4.27) Y v (x, X) = (c(x, X) v (x, A)) : H n © H n -> H, A£C+UC_, 

(4.28) C(x) = {C 1 (x),C 2 (x)} (£ H n © H n ). 

Next we show that the functions (4.27), (4.28) satisfy hypothesis of Lemma 3.1. 
In view of (3.25) and (3.26) Y v (-, A) is the solution of (3.4) with the initial data 

f4 29l Y(0 X)- f c(1) (°' A ) ^(MA _ f/fl* ~m(X)\ 

(429) A) " l^)(0, A) ^ 2) (0, X))-{0 I H n J' AgC + uC - 

Hence £ p(Y v (0,X)) and, consequently, £ p(Y v (x,X)) for all x £ A. Next the direct 
calculation with taking the relation m*(A) = m(A) into account gives Y„*(0, A) J^™ 1^,(0, A) = 
J H n, where J H ™ is the operator (2.1). Moreover the Lagrange's identity (3.10) implies 

Y*(x, X)J H ™Y v (x, X) = Y v *(0,X)J Hn Y v (0,X) (= J H n), x £ A. 
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Therefore in view of the invertibility of Y v (x,X) one has Y v (x,\)Jh^Y*(x : X) = Jh™, 
which is equivalent to the relations 

(4.30) c (1) (^,A)^ 1} *(x,A) -v^(x,X)c^*(x,X) = 0, 

(4.31) c {2 \x,X)v ( o ] *(x,X)-v^(x,X)c^*(x,X) = 0, 

(4.32) c^{x,X)v^*{x,X) -v^{x,X)c^*{x,X) = -I H n, x G A, A G C+ U C_ 
It follows from (4.30), (4.32) that 

c {1) {x,X)v* {x,X) -v { q\x,X)c*(x,X) = 0, 
c {2) (x,X)v* (x,X) -v ( u\x,X)c*(x,X) = (-I H ... 0) T , x G A, AgC+UC_. 
Moreover the equalities (4.26), (4.28) give 

C'{x) = {v* {x,X) -c*(x,X)) T f{x) (mod /i). 
Hence nearly everywhere on A one has 




cM(x,X) v [ 2) (x,X) J \-c*(x,X) 

which coincides with (3.8). Therefore according to Lemma 3.1 the function (4.25) belongs 
to V(l) and obeys the relations 

(4.33) l[y] -Xy = f, y(x, A) = Y v (x, X)C(x). 

Since / G Sj b , it follows from (4.26) that Ci(x) = and C 2 (x) = C 2 (G H n ) on some 
interval (77, b) C A. Hence by (4.25) y = t>o(x, A)C 2 , x G (77, 6), which yields the inclusion 
y G X>. Moreover according to [20] (see proof of Lemma 3.4) T' y = T' (vo(x, A)C*2) and by 
(3.20) F' y = 0. Finally combining the second equality in (4.33) with (4.29) and (4.28), 
we obtain t/ 2 )(0, A) = C 2 (0) = 0. 

Thus the function (4.24) satisfies the boundary conditions in the right hand part of 
(3.18) and, consequently, it belongs to V(A ). 

Step2. Next by using formula for resolvents (2.34) we prove (4.21) for all / = f(t) G Sjb 
and A G p(A) fl C+. Applying Lemma 4.4, 3) to the solution Z-(-, A) and taking (3.28) 
into account one obtains 

1 l(X)f = JZ*_(t,X)f(t)dt, AgC + , fe$) b . 


This and (3.27) yield 

( 7+ (A)(C7 + C7 1 M + (A))- 1 C7 l7 :(A)/)(x) = 

/ Z + (x, A)(C7 + C 1 M + (A))- 1 C 1 Z!(t, X)f(t) dt = / G^x, t, X)f(t) dt, 


where 

(4.34) Gi(:M,A) = Z + (x,X){C + C 1 M + {X))- 1 C 1 Z*_(t,X), Xe p{A) nC + . 

Moreover the resolvent (A — A)" 1 is defined by (4.22). Hence formula (2.34) for the 
decomposing D-triplet n takes the form 

(4.35) ((A-\)- 1 f)(x)=JG(x,t,\)f(t)dt, f = f(-)efi b , Xe P (A)nC + , 



where G(x, t, A) = G (x, t, A) — Gi(x, t,X), AG p(A) n C + . Now it remains to show that 
G(x,t, X) coincides with the Green function Ge(x,t,X) (see (4.20)). 
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Denote by G + (x, t, X) and G-(x, t, A) restrictions of G(x,t,X) onto the sets : 
x > t} and {(x, t) : x < t} respectively. It follows from (4.23) and (4.34) that 

(4.36) G+(x,t,X) = -v (x,X)c*(t,X) - Z+(x, A)(C + C 1 M+(A))- 1 C 1 Z:(t, A), 

(4.37) G*_(x,t,X) = -v (t,X)c*(x,X) - Z^(t,X)Cl(C* + M_(X)C{)- 1 Z* + (x,X). 

Next assume that 6 X = {(C 0x , C*i x ); /C x } G C(7i ,7^i) is the x-adjoint operator pair 
(4.2) and let 6* = {(C u , C *); /C x } G C(Hi,H ) be the adjoint pair with Ci* and C * 
given by (2.10). It follows from (4.2) that the block-matrix representations 

(4.38) C U = (C 2X CjJrfreWi-^/Cx, C * = (-C , ix Ci):H n ®H' ^lC x . 

are valid with = Cq x f 7^ and C^ = C' lx P{ — iC^P^. Now by using Lemma 2.3 we 
can rewrite (4.37) as 

(4.39) G*_(x,t,X) = -v (t,X)c*(x,X) - Z_(t,X)(C u +C *M-(X))- 1 C *Z![.(x,\). 
Let 

(4.40) Fi(t,A) := (-c(t,X) 0) : H n ®H' -> tf, F 2 (t,A) := (— c(t, A) 0) : H n eWi -> H 
and let Yl(-, A) : A — > [7Y , Y + (-,X) : A — > [7ii, H] be operator solutions given by 

(4.41) Y_(t,X) := Y 1 (t,X) - Z_{t,X)Cl{C* + M.^C?) -1 

(4.42) y + (t, A) := y 2 (t, A) - Z + (t, X)Cl(Ct + M + (A)C*J- 1 
Combining (4.40) with (3.23) and (3.24) one obtains 

-v (x,X)c*(t,X) = Z + (x,X)Y*(t,X), -v (t,X)c*(x, A) = X)Y*(x, A). 
Hence the equalities (4.36) and (4.39) can be represented as 

(4.43) G+(x,t,\) = Z + (x,X)Y*(t,X), G*_(x,t,X) = Z_(t,X)Y*(x, A) 

It follows from (3.27) and (3.28) that the corresponding operators (4.13) and (4.18) for 
Z + (-,X) and Z_(-,X) are 

t = (c r + c 1 r 1 ) 7+ (A), t x = (c 0x r + c^r^.Q). 

Therefore by Lemma 2.9 one has 

(4.44) T = C + C 1 M+(A), T x = C u + C *M_(A). 

Next by (4.41) Yl(-, A) is the operator solution if the equation l[y] — Xy = and 
y_(0, A) = Fi(0, A) - Z_(0, A)C*(C* + M^C*)" 1 = X(C* + M_(A)C*) _1 , 

where 

X = ?i(0, A)(C* + M_(A)C*) - Z_(0, A)C* = 



-/ 




CSVfmW M 2 _(A)W-Q 
+ Ws-(A) M 4 _(A); 



-m(A) -M 2 _(A)\ f-C* 

'-C* + m{X)C$ - M 2 _(X)C' 1 *\ _ ( m(X)C* - M 2 _(A)Cf\ = f-C* 
J \ -CI J V c i 

(here we made use of the block-matrix representations (4.1), (3.17) and (3.26)). This 
implies that the solution YL(-, A) satisfies the initial data 

(4.45) y_(0, A) = (-6* (7*) T (Co + M^CIY 1 = {-C* C'*) T T~ u 
Similar calculations for Y + (t,X) (with taking (4.38) into account) gives 

(4.46) ? + (0, A) = (-C* x (7* X ) T (CT, + M + (A)C *J- 1 = (-C 2 * x C* lx ) T T' 1 *. 
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Comparing (4.45) and (4.46) with (4.17) and (4.19), one obtains Y_(t,X) = Y e (t,X) and 
Y+(t, A) = Y e x (t, A). Now the equality G(x, t, A) = G (x, t, A) is implied by (4.43). 

Step 3. To complete the proof it is necessary to extend the above result to all f E $) 
and A G p(A). 

If A G p(A) n C_, then A G p(A*) n C+ and, consequently, 

(4.47) ((A* - A)-V)(x) = JG e 4x,t,\)f(t)dt, f = /(•) G £ 6 . 

o 

Since (A-X)- 1 = ((^-A)" 1 )*, it follows from (4.47) that (l-A)" 1 ^ is the integral op- 
erator with the kernel G'(x, t, A) = (G e x (t, x, A))* = Ge(x, t, A) (here the second equality 
is immediate from (4.20)). Therefore (4.21) holds for all / G S)b and A G p(A) n C_. 

Next assume that Ao G p(A) fl R. Then there exists a disk U(Xq) = {X G C : |A- 
Aq I < s} (e > 0) such that £/(Ao) C p(A). Let Z(-) be an operator function (4.11) 
and let Z(-, X) (A G p(^4)) be a family of fundamental solutions (4.12) (see the proof of 
Theorem 4.6). Since by Proposition 3.9 in [22] Tj G [D + ,Hj] : j G {0, 1}, the operator 
functions 

t(A) = (C7 r + c7 1 r 1 )z(A), r x (A) = (C7 0x r + c7 lx r 1 )z(A), a g u(x ) 

are holomorphic on U(X ). Let now y(-, A) : A -> [/C', i7] and y x (-, A) : A -> [/C', //] be 
operator solutions of (3.4) with 

y(o,x) = (-c; cd t (t(%)- u , y x (o,x) = {-c* x c* x ) t (t x (a))- 1 *, ag^(a ) 

Then for every A G C/(Aq) the corresponding Green function (4.20) can be written as 



(4.48) G (x,t,X) 



z(x,x)y*(t,x), x>t 
y x (x,x)z*(t,x), x<t 



Since all initial data Z(0, A), y(0, A) and y x (0, A) are continuous (and even holomorphic) 

at the point A , it follows from (4.48) that lim sup \\Gg(x,t, A) — Gg(x,t, A )|| = for 

A ^ A « ( x ,t)eR 

each closed rectangle R C A x A. Therefore for every / = /(•) G f)b we can pass to the 
limit in the equality (4.21) as C + 3 X — > A , which gives the same equality for A = A . 
Hence (4.21) holds for all A G p(2) and / G # 6 . 

Finally (4.8) implies existence of the limit lim^-fb / Gg(x,t, X)f(t) dt for all /(•) G , 

o 

which completely proves (4.21). □ 



5. Generalized resolvents and characteristic matrices of differential 

operators 

5.1. Generalized resolvents and characteristic matrices. In this section by using 
the concept of a decomposing D-triplet we complement the known results on generalized 
resolvents and characteristic matrices of differential operators [27, 3]. 

Assume that II = {Ho ® Hi,T ,Ti} is a decomposing D-triplet (3.12) for L and 
7±( - )> M±(-) are the corresponding 7-fields and Weyl functions (see (2.25)-(2.27)). More- 
over let r = {t + , t_} G R(Ho, Hi) be a collection of two holomorphic operator pairs 

(5.1) r+(A) = {(C (A), Ci(A)); /C+}, A G C + ; r_(A) = {(D (X), D^X)); £_}, A G C_ 
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with the block-matrix representations 

(5.2) C (A) = (C 2 (X) C' (X)) :H n ®H' ^ K+, 

d(A) = (C'i(A) Ci(A)) : # n © Wi -> /C+, AG C+ 

(5.3) £> (A) = (4(A) D' (X)) : H n © ^ - /C_, 

D^A) = (4(A) £>i(A)) : # n © Wi -> /C_, AG C_ 
Consider the operator functions T+ (A), A G C + and T_(A), A G C_ given by 

(5.4) f + (A) = (C (A)r - Ci(A)r 1 ) 7+ (A), TL(A) = (D (X)T - L> 1 (A)r 1 ) 7 _(A). 
Moreover introduce the operator pair r_(A) = {(4(A), 4(A)); /C_}, A G C_ via 

(5.5) 4(A) = L> (A) r Hi = (4(A) ^(A) f W'J : © K - /C_, 

(5.6) 4(A) = A(A)Pi + iD (A)P 2 = (4(A) £> 1 (A)P 1 / + iD' {X)PQ :H n ®H' ^ /C_. 
Since (-r+(A)) x = -r_(A) = {(A)(A), -£>i(A)); /C_}, it follows from (2.10) that 

(5.7) (-r+(A))* = {(^(A), -4(A)); /C_} = -r_(A), A G C_ 
This and Lemma 2.9 yield 

(5.8) f+(A) = C (A)-Ci(A)M+(A), A G C+; T_(A) = 4(A)-4(A)M_(A), A G C_ 

The following theorem, which is immediate from Theorem 2.12, contains the description 
of all generalized resolvents of the minimal operator L in terms of boundary conditions. 

Theorem 5.1. Let IT = {H (BHi,T ,T 1 } be a decomposing D -triplet (3.12) for L. Then 
for every collection r = {t + ,t_} G R(TCo,H,i) , given by (5.1) - (5.3), the equality 

(5.9) V(A(X)) = 

UyeV: C\(X)y( l \0) + C 2 (X)y^(0) + C' (X)T' y - C[(X)T' iy = 0}, AG C + 
\{y G V : D!(A)y«(0) + D 2 (X)y^(0) + L^(A)r> - D' 1 {X)Y' 1 y = 0}, AG C_ 

defines a family of proper extensions A(X) = L \ T>(A(X)) such that the operator function 

(5.10) R(A) = R T (A) := (1(A) - A) -1 , AgC+UC_ 

is a generalized resolvent of L . Conversely for every generalized resolvent R(A) of the 
operator L there exists the unique collection r = {t + ,t_} G R(Ho,'Hi) such that (5.9) 
and (5.10) hold. Moreover R(A) «s a canonical resolvent if and only if r G R°(Ho,Hi) . 

By using Theorem 4.10 one can represent the above result in a rather different form. 
Namely, let Z±(-,X) be fundamental solutions (3.23), (3.24) and let T + = T+(A) (T_ = 
T_(A)) be the operator (4.13), corresponding to the operator pair — r + (A) = {(Co(A), 
-Ci(A));/C+} (respectively -r_(A) = {(£>o(A), -Di(A)); /C_}Jor a fixed A G C+ (A G 
C_). Then in view ofj3.27) and (3.28) T±(A) = T±(A), where 7±(A) are defined by (5.4). 

Next assume that A(X) is a family of extensions (5.9). Then A G p(A(X)) and according 
to Theorem 4.7 G p(T±(A)), A G C ± . This and (5.8) make it possible to associate with 
every collection r = {t + , t_} G R(Ho, 'Hi), given by (5.1) - (5.3), the families of operator 
solutions Y T+ (-, A) : A -> [7Yi,#], A G C + and F T _(-, A) : A -> [W ,#], A G C_ of the 
equation (3.4) defined by the initial data 

(5.11) y r+ (0,A) = (-4(A) 4(A)) T (4(A)-M + (A)5*(A))- 1 , A G C + 

(5.12) y r _(0,A) = (-(7*(A) C7*(A)) T (C *(A)-M_(A)C*(A))- 1 , A G C_. 
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Moreover introduce the operator functions 

(5.13) = H''V e ^ ; Z oM )=H ( ' A >' AeC + 

v ; y ! yY T -{t, A), A g C_ y ! [Z-(t, A), A e C_. 

One can easily verify that Yr(-,A) is uniquely defined by r and does not depend on 
(equivalent) representations (5.1). 

Definition 5.2. The operator function G T (-, •, A) : A x A — > [i/], given by 

r*nn rf.m jz (x,X)Y T *(t,X), x>t X(=rnr 

5.14) G T (x,*,A) = < , AGl+Ul- 

I Y T (x, X) Z^t, A), x<t 

will be called the Green function, corresponding to a collection r = {r + , r_} G R(Hq, Hi). 

Now combining statements of Theorems 4.10 and 5.1 we arrive at the following theo- 
rem. 

Theorem 5.3. Let under conditions of Theorem 5.1 r G R(Ho,Hi) and let R(A) = 
R T (A) fre £/ie corresponding generalized resolvent given by (5.9) and (5.10). TTien 

(5.15) (R(A)/)(x) =JG T (x,t,\)f(t)dt := ]im J G T (x,t, X)f(t)dt, f = /(•) G 

o ^To o 

which implies that the equalities (5.14) and (5.15) establish a bijective correspondence 
between all generalized (canonical) resolvents R(A) of the minimal operator L and all 
collections r G R(Ho,Hi) (respectively, r G R°(Ho,Hi)). 

Assume that II = {Ho © Hi,Tq,Ti} is a decomposing D-triplet (3.12) for L, M±(-) 
are the corresponding Weyl functions and r = {t + ,t_} G R(Ho,Hi) is a collection of 
holomorphic operator pairs given by (5.1) or, equivalently, by (2.11). Then according 
to [22] G p(r + (A) + M + (A)), which in view of [19], Lemma 2.1 is equivalent to each of 
the inclusions G p(C7 (A) - Ci(A)M+(A)) and G p(#i(A) + M + (X)K (X)), A G C+. 
Moreover the same lemma in [19] yields 

(5.16) -(r+(A) + M + (A))- X = (C (A) - C 1 (A)M + (A))- 1 C 1 (A) = 

= -K (A)(K 1 (A) + M + (A)X (A))- 1 , A G C + 

With every collection r = {t + ,t_} G R(Ho,Hi) we associate two holomorphic opera- 
tor functions n T+ (-) : C+ -> [W ©Wi,WieWo] and Q r _(-) : C_ -> [Wi © W , W o Wi]. 
The first of them is given by the block-matrix representation 

(5.17) Q T+ (A) = : © Hi - Wi © Ho, AG C + , 
with entries 

(5.18) Ci+(A) = M+(A) - M+(A)(r+(A) + M + (A))- 1 M + (A) 

(5.19) u 2+ (X) = -\l Hl + M + (A)(r + (A) + M + (A))^ 

(5.20) u 3+ (X) = -\l Ho + (r+(A) + M + {X))~ l M + (X), u 4+ (X) = -(r+(A) + M + (A))-\ 
while the second one is defined by the relation 

(5.21) Q T _(A) = (fJ T+ (A))*, A G C_. 
It follows from (5.16) that 

(5.22) (r+(A) + M + (A))- X M + (A) = -(C (A) - C 1 (A)M + (A))- 1 C7 1 (A)M + (A) = 

= J Wo - (C (A) - C 1 (A)M + (A))- 1 C (A), A G C+. 
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This and (5.16) imply that formulas (5.18)- (5.20) can be represented as 

(5.23) 2 1+ (A) = M + (A)(C7 (A) - C 1 (A)M + (A))- 1 C7 (A) 

(5.24) u 2+ (X) = -\l Hl - M + (A)(C7 (A) - C 1 (A)M + (A))- 1 C7 1 (A) 

(5.25) £ 3+ (A) = \l Ho - (C (A) - C 1 (A)M+(A))- 1 C (A), 

(5.26) u 4+ (X) = (C (A) - C 1 (A)M + (A))- 1 C 1 (A). 

Similar arguments for the operator function ft r _(-) with taking (5.7) into account gives 

(5.27) ft r _(A) = ■ Hi © Ho - n © Wi, AG C_, 
where 

(5.28) 2i_(A) = Af_(A)(5i(A) - 5 (A)M_(A))- 1 5i(A) 

(5.29) £ 2 _(A) = -\l Ho - M_(A)(i\(A) - J D (A)M_(A))- 1 5 (A) 

(5.30) S 3 -(A) = i/ Wl - (5i(A) - 5o(A)M_(A))^ 1 5 1 (A), 

(5.31) 5 4 -(A) = (5i(A) - D (A)M_(A))- 1 J D (A). 

and the operator functions Di(') an d A)(') are defined by (5.5) and (5.6) respectively. 

Since H n G H and H n G H u it follows that H n © #™ C H © Hi and H n @ H n C. 
Hi ©Ho- Therefore with every collection r = {r + , r_} G i?(Ho, Hi) we can associate the 
operator function f2 T (-) : C + U C_ — > [H n © if™] given by 



(5.32) fi r (A) 



P^n e ^n ft r+ (A) t ff n © /J", AG C+ 

Ph»®h» (X) \ H n ®H n , AG C_ 



It follows from (5.21) and (5.32) that fi T (-) is a holomorphic operator function obeying 
the relation ft; (A) = fi r (A), A G C + U C_. 

Theorem 5.4. Let II = {7f ©Hi, r , Ti} be a decomposing D -triplet (3.12) for L. Then 
for every collection r = {t + ,t_} G ff(Ho,Hi) the corresponding Green function (5.14) 
admits the representation 

(5.33) G T (x,t,\) =Y (x,X)(n T (X) + lsgn(t-x)J H n)Y*(t,X), X G C+ U C_, 
where Y (-,X) is the "canonical" solution (3.6) and J H n is the operator (2.1). 
Proof. Let M±(-) be Weyl functions (3.16), (3.17) and let 

(5.34) S + (X) := (-M+(A) J Ho ) T :H ^H 1 ®H , A G C + 

(5.35) S_(z) := (-M_(z) I Hl ) T : Hi ->W ©Wi, -2 G C_. 

Introduce the operator functions 5+ (A) (G [H , H n ©// n ]), A G C+ and S_(z)(e [Hi,ff n © 
ff n ]), z G C_ by 

(5.36) S + (A) = Pfl«efl»5 + (A) = (~^ A) ~ M ^ X ^ : H n ® H' ^ H n ® H n 

(5.37) = P Hnmn S_{z) = (^~™[ z) ~ M ^ Z ^ : H n © ^H n @H n 
It follows from (3.25) and (3.26) that 

(5.38) Z+(0,A) = 5+(A), A G C+; Z-(0,z) = S-(z), z G C_. 
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Next assume that a collection r = {t + ,t_} G R(Hq,Hi) is given by (5.1)-(5.3) and 
let y r+ (-, A), F r _(-, A) be operator solutions of (3.4) with the initial data (5.11), (5.12). 
Moreover consider the operator functions 

A + (X) = (-Co(A) C 1 (A)):W eWi^/C + , A G C + 
A_(A) = (-5i(A) 5„(A)) : Hi © H -> /C_, A G C_, 
where C^A) and Z^A), j G {0, 1} are defined by (5.1), (5.5) and (5.6). Then 
A + (X) \H n @H n = (-Cb(A) r Ci(A) f # n ) = (-62(A) Ci(A)) : H n ® H n ^ /C+, 
A_(A) \H n ®H n = (-D 1 (X) \ H n D (X) \ H n ) = (-D 2 (X) D^X)) : # n © # n -> /C_ 
and the equalities (5.11) and (5.12) give 

?; + (0, A) = (-Di(A) - D (X)M_(X))-\-D 2 (X) £>i(X)) = 

= (5i(A) - 5 (A)M_(A))- 1 A_(A) t H n ®H n , A G C_ 
?;J0, A) = (C (A) - C7 1 (A)M + (A))- 1 (-C' 2 (A) Ci(A)) = 

= (C (A) - C7 1 (A)M + (A))- 1 A + (A) \H n ®H n , AG C+ 

This and (5.38) yield 

(5.39) Z + (0,A)y;_(0,A) = P HnQHn S + (X){C (X)-C 1 (X)M + (\))- 1 A + (X) \H n ®H n , 

(5.40) Z_(0, A)F r ;(0, A) = P fl n eflW 5_(A)(5 1 (A) - 5 (A)M_(A))- 1 A_(A) f H n © fT\ 
where 

5+(A)(C (A) - C 1 (A)M + (A))- 1 A + (A) = 




(C (A) - C7 1 (A)M + (A))- 1 (-C7 (A) d(A)) = 



/M+(A)(C (A) - C7 1 (A)M + (A))- 1 C7 (A) -M+(A)(C (A) - C 1 (A)M + (A))- 1 C7 1 (A)\ 
^ -(Co(A)-C 1 (A)M + (A))- 1 C (A) (C (A) - C7 1 (A)M + (A))- 1 C7 1 (A) j " 

= Vt T+ (X) - \ jd Hq ^ Hi 

(here the last equality is implied by (5.23)-(5.26) and (2.1)). Hence by (5.32) and the 
obvious equality Ju n = Pu n ®n n Jna,Hx \ H n © H n one obtains 

(5.41) z + (o,a)i?_(o,a) = Pfln efl n(n T+ (A)-ij WoiWl ) r /refr = n T (A)-ij H » 

for all A G C+. Similarly starting with (5.40) and using the representation (5.27)-(5.31) 
of f2 r _(A) one proves 

(5.42) Z_(0,A)y r ;(0,A) = n T (A) - |Jfln, AgC_. 
Now (5.41) and (5.42) imply that the operator functions (5.13) obey 

(5.43) Z o (0,A)y T *(0,A) =n T (A) - iJfln, AgC + UC_. 

Next consider the corresponding Green function (5.14). It follows from (3.7) that 
Z (x, A) = Y (x, A)Z (0, A) and Y T (x, A) = Y (x, A)F T (0, A). This and (5.43) give 

G T (x,t,X)^Y (x,X)(Z (0,X)Y T *(0,X))Y*(t,X) = 

= Y (x,\)(n T (\)-±J H n)Y *(t,J), if x>t, 

G T (x,t,X)=Y o (x,X)(Y T (0,X)Z* o (0,X))Y*(t,X) = 

= Y (x,X)(n* T (X) - y* Hn )Y*(t,X) = Y (x,X)(Q T (X) + ±J H n)Y*(t,X), if x < t, 
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which is equivalent to (5.33). □ 

Comparing (5.33) with (1.4) and taking Theorem 5.3 into account one concludes that 
f2 T (-) is a characteristic matrix in the sense of Shtraus [27, 3]. This allows us to introduce 
the following definition. 

Definition 5.5. The operator function tt(-) = Q T (-) : C+ U C_ -> [H n © H n \ defined 
by the relations (5.17)-(5.21) and (5.32) will be called the characteristic matrix of the 
operator L corresponding to a collection r = {r + , t_} G R(Ho,Ti.i). 

Since by Theorem 5.1 formulas (5.9) and (5.10) give a bijective correspondence between 
all r G R{T-Co,Hi) and all generalized resolvents M(A), the operator function f2(-) = 
f2 r (-) will be also called the characteristic matrix of L corresponding to the generalized 
resolvents R(A) = R T (A). 

The characteristic matrix fi r (-) will be called canonical if it corresponds to a canonical 
resolvent R r (A) or, equivalently if r G R°(li,o,TCi). 

Remark 5.6. To compare the representations (5.14) and (5.33) of the Green function note 
that in the case dimH = 1 (the scalar case) and n + (L ) = n_(L ) := m the operator 
solution Y T (-, A) in (5.14) contains less components than Y (-, A) in (5.33) (more precisely, 
m and 2n components respectively). Therefore we suppose that formula (5.14) for the 
Green function may be useful in the sequel. 

5.2. Description of characteristic matrices and their properties. It is clear that 
formulas (5.17)-(5.21) and (5.32) describe in fact all characteristic matrices of the oper- 
ator L by means of a "boundary" parameter r G R(Ho,H,i). The same description in a 
rather different form is specified in the following theorem. 

Theorem 5.7. Assume that IT = {Tio (B Ti.i,TQ,Ti} is a decomposing D-triplet (3.12) 
for L, M±(-) are the corresponding Weyl functions (3.16), (3.17) and S±(-) are operator 
functions (5.36), (5.37). Moreover, let A G Ext Lo be the maximal symmetric extension 
(3.18) and let M. (\) be a generalized resolvent of L given by 

M (A) = 

Then: (i) the characteristic matrix of the operator L , corresponding to the generalized 
resolvent M (X) is 

(5.44) ft (A) = ( "5^ ~i ///n l : H n © H n -> H n © H n , A G C+ U C_; 
(ii) the equality 

(5.45) n(x)(=n T (\)) = n (\)- s + (\)(r + (\) + M + (\))- l s*_(\), agc+ 

establishes a bijective correspondence between all characteristic matrices Q(X) of the op- 
erator L and all collections r = {t + ,t_} G RiHoj'Hi)- Moreover the characteristic 
matrix f2(A) in (5.45) is canonical, if and only if r — {t + ,t_} G R°(Ho,TLi). 

Proof. Let fi (-) be the operator function (5.44). Then the equalities (5.32) and (5.17)- 
(5.20) imply 

nr(A) = iw- ( M r^ o } r n n © h»- 

-Ph~ 9 h* (~ M I ^ X) ) ( r +( A ) + M + (A))- 1 (-M!(A) I Hl ) \ H n ®H n , AG C +J 
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where 

W- -^') r «" ® = ( P "' U _fl ' -^"") = «o(A). 

Combining these relations with (5.34)-(5.37) we arrive at (5.45). 

Next assume that r = {r 0+ ,r _} G R(H ,Hi) is a collection given by 

T 0+ (A)^o:={0}©fti(eC(fto,^i)), AeC + ; r _(A) = fl x , A G C_. 

Then in view of (2.24) the corresponding generalized resolvent R T0 (A), defined by (5.9) 
and (5.10), coincides with R (A). On the other hand, (r +(A) + M + (X))~ l = 0, A G C + 
and by (5.45) £V (A) = ^o(A). This implies the statement (i) of the theorem. □ 

The following lemma will be useful in the sequel. 

Lemma 5.8. Assume that $),H and Ho are Hilbert spaces, Hi is a subspace in Ho, 
H 2 := H © Hi, A is an open set in C and A(-) : A -> [H © H ,H © Hi], t(-) : A -> 
[7i©7io,-£)] are operator functions given by 

(5.46) A(A) =(^] ^):WeWo-We Wl , AG A 

(5.47) 7(A) = (71(A) 72(A)) : H © H -> A G A 
and obeying the relation 

(5.48) - A*(A)P WeWl + l P W2 = (/^- A)7*(A)7(/x), /x, A G A. 

Moreover Ze* r(A) = {X (A), A"i(A); K} (G C(H ,Hi)), X e A be a C(H , Hi) -valued 
function (an operator pair, see (2.4) ^ with G p(r(A) + 04(A)) and /e£ <p r (-) : A — >• [H] 
be a transform of r(-) defined by 

(5.49) v^r(A) = a x (A) -a 2 (A)(r(A) + a 4 (A))- 1 a 3 (A), A G A. 
Taen 

(5.50) ^(^ - <(A) = (/i - A) 7 ;(A) 7 .(/i) + ^(AXi^A)/^) - ^(A)K i(^)- 

-iK^(X)Ko2(n))P(fi), ^,AGA, 

waere 7r (A)(G /3(A)(G [7Y,/C]) and #<y(A)(e [/C,Wj]), J G {1,2}, A G A are 

operator functions given by 

(5.51) 7 r(A) = 71(A) - 7 2 (A)(r(A) + o 4 (A))- 1 o 3 (A), 

(5.52) (3(X) = (Ki(X) + a 4 (A)K (A))- 1 o 3 (A), 

(5.53) K (X) = (K 01 (X) K 02 (X)) T :K^Hi@H 2 . 

Proof. First observe that (5.48) is equivalent to the relations 
(5.54) 

ai(/j,) - a*(A) = (// - A)7i(A)7i(//), a 4 (/i) - 04(A) Pi + iP 2 = (p - A)7 2 (A)7 2 (/x), 

(5.55) a 2 (/i) - a 3 (A)Pi = (/i - A)7*(A)7 2 (//), a 3 (/x) - a£(A) = (// - A)t^(A)7i(^), 
where P, is the orthoprojector in 7i onto 7Yj, j G {1,2} and /i, X G A. Letting 

(5.56) ai (A) = (/^(A) + o 4 (A)^o(A))~ 1 , a(A) = (r(A) + 04(A))" 1 = K (X)ai(X), 
one rewrites (5.49) and (5.51) as 

(5.57) <p T (X) = ai(X) - a 2 (X)a(X)a 3 (X), 7r (A) = ^(A) - 7 2 (A)a(A)o 3 (A). 
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Combining these equalities with (5.54) and (5.55) one derives 

Qjl - XK(XhM = (/x - A)(tJ(A) - oS(A)a*(A)TS(A))(7i(/i) - 72^)«(^a 3 (//)) = 
ai(/i) - a*(A) - a 3 (A)aj*(A)(a 3 (/x) - a^A)) - (a 2 (/x) - a 3 (A)Pi)a(^)a 3 (/i) + 
a 3 (A)a*(A)(a 4 (^) - al(X)P 1 + iP 2 )a(fi)a 3 ([i). 

Thus 

(5.58) (/i - A) 7 ;(A) 7 r(/i) = <PM - tf(A) + a*(A)X(/i, A)a 3 (/i), 

where A) = a* (A) f • a 4 (^)a(/i) — a*(A)a4(A)PiQ;(/x) + za:*(A) \ H 2 ■ P 2 a(fj,)+ 

+Pia(/i) - a*(A) tWi- 

It follows from (5.56) that 

= K 01 (pi) ai (pL), a*(X) \ H x = al(X)K* 01 (X), 
a*(X) \ H 2 ■ P 2 a(/i) = at(X)K* 2 (X)K MaM 

and, consequently, 

X([j,,X) = a*(A)ir * 1 (A)a 4 (/i)K (^)ai(^) - at{X)K*(X)a* 4 (X)K 01 ([j,)a 1 ([j,)+ 
iat(X)K* 2 (X)KMaM + KM^M - ^(X)K* 01 (X) = at(A)[K* 1 (A)a 4 (/i)K (^)- 
K*(X)al(X)K 01 (f,) + iK* 02 {X)KM + (AT*(A) + X*(A)a:(A))X i(^) - K* 1 (X)(K 1 ( f i)+ 
a A {ii)KM)\aM = a\{X)[Kl{X)KM - K^X)^) + iK* 02 {X)KM\aM- 
Substituting this equality in (5.58) we arrive at the required identity (5.50). □ 

Proposition 5.9. Assume that II = {Ho ®Hi, T , Ti} is a decomposing D- triplet (3.12) 
for L and M + (-) is the corresponding Weyl function. Moreover let r = {t + ,t_} G 
R(Ti,o,Ti,i) be a collection of holomorphic operator pairs (5.1)-(5.3). Then: 

1) for every X G C + there exists the unique pair of operator functions Uj T (-,X) G 
L' 2 [H n ,H], j G {1,2} obeying the equation (3.4) and the boundary conditions 

(5.59) (C\(X)ufJ(0, A) + C 2 (X)u^(0, X))h + (C' (X)T' - C^T'^u^t, X)h) = 

= (-iy- 1 C ] (X)h, heH n , je{l,2}. 

2) The operator functions Uj T (-,X) are connected with the operator solution (3.23) via 

(5.60) ^ r (t,A) = (-iy- 1 Z + (t,A)(C (A)-C 1 (A)M + (A))- 1 C',(A), jG {1,2}, A G C+. 
Proof. First observe that in view of (5.2) the conditions (5.59) are equivalent to 

(5.61) (o,(A)r - dwrjiujrtt, x)h) = (-ly-'Cjixyh, heH n , 3 e{i, 2}. 

Let Uj T {-, X) G L' 2 [H n , H], j G {1, 2} be operator solutions of (3.4) given by (5.60). Using 
Lemma 2.9 one obtains 

(Co(A)r - Ci(A)r 1 )(Z+(t, X)h ) = (c (A)r - C 1 (A)r 1 ) 7+ (A)/i = 

= (C (X)-C 1 (X)M + (X))h , h eH . 

Hence the operator functions Uj T (-, A) obey (5.61) and, consequently, (5.59). Next assume 
that a pair of operator functions u'j(-,X) G L' 2 [H n ,H] also obeys (3.4) and (5.59) and 

let yj := Uj T (t, X)h — u f j(t, X)h, h G H n , X G C + . Consider the extension A(X) G Ext^ 
given by (5.9). It is easy to see that yj G T>(A(X)) fl yi\(Lo), X G C+. At the same time 
A G p(A(X)) (see (5.10)) and, therefore, V(A(X)) n 9t A (L ) = {0}. Hence y t = and, 
consequently, Uj T (t, A) = u'j(t, A), j G {1,2}. This implies the uniqueness of Uj T (-, A). □ 
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Now we are ready to prove that the characteristic matrix fl T (-) is a Nevanlinna operator 
function. This statement will be implied by an identity for Q T (-), which, to our mind, is 
of self-contained interest. 

Proposition 5.10. Let the assumptions of Propositions 5.9 be satisfied and let (2.11) be 
the equivalent to (5.1) representation of r. Moreover let Uj T (-,X), j G {1,2} be operator 
solutions introduced in Proposition 5.9, let 

(5.62) U T (t,X) := (u 2r (t,X) u lT (t,X)) : H n ® H n -> H, X G C+ 

and let : C + — > [H n © H n ,JC' + ] be the operator function given for every X G C + by 
the block-matrix representation 

(5.63) /3(A) = (-(K 1 (X)+M + (X)K (X))- 1 M + (X) \ H n (K 1 (A)+M + (A)K (A))- 1 \ H n ) 
Then: 1) the corresponding characteristic matrix Q T (-) obeys the identity 

(5.64) n T (fi)-n* T (x) = (fi-x) [ u;(t,x)u T (t,(j,)dt + p^x^k^km- 

Jo 

-Kl(X)KM - iK* 02 (X)K 02 (pi))P(pi), fi, X G C + , 

in which the operator functions K j(-) : C + — > [tC' + ,Tij], j G {1,2} are defined by the 
block-matrix representation 

K (X) = (K 01 (X) K 02 (X)) T :KJ+^H 1 ®H 2 , AG C+. 

The integral in (5.64) converges strongly, that is 

(5.65) / U*(t,X)U T (t,ii)dt = s -lim / U*(t, X)U T (t, fi) dt. 

Jo Vlb Jo 

2) the characteristic matrix fi T (-) satisfies the inequality 
Im Q (u) b 

(5.66) - tW >fUXt,n)U T (t,n)dt, ^GC + , 

Im n o 

which turns into the equality for canonical characteristic matrices. Formula (5.66) im- 
plies that fi r (-) is a Nevanlinna operator function. 

Proof. 1) It follows from (5.45) that fi r (-) is a transform (5.49) of t + (A) with operator 

coefficients %(A), j — 1 -j- 4, which are entries of the matrix 

(5.67) 

^ few Sw) : = B &w) (e e e Wo ' e e Hl|) - 

To prove (5.64) we apply Lemma 5.8 to ^4n(A). 
Assume that 7+(-) is the 7-field (2.25) and 

(5.68) 71(A) := (- 7+ (A) \H n 0) : H n (B H n — > f), 7 2 (A) := 7+ (A)(G [H , «]) 

for all A G C + . Let us show that the matrix (5.67) obeys the relations (5.54) and (5.55) 
(or, equivalently, (5.48)) with the operator functions (5.68). To this end observe that 
the equalities (5.54) are immediate from (2.28). Next, the first relation in (5.55) can be 
written in our case as 

(5.69) S + (jm) - SL(A)P! = (jjl - A) ("^q 7 ^) 7+(//); ^ A e c+> 

where P#n is the orthoprojector in 7io(= H n © 7Yq) onto i/ n . To prove (5.69) note that 
# n C H x and, consequently, Pa* Pi = Ph», Ph-P 2 = 0. This and (5.36), (5.37) yield 

S + (fi) = (-P H nM + {n) P Hn y :H ^H n ® H n , 

5_(A)Pi = (-P ff ,MI(A) P^) T P! = (-P H nMl(X)P 1 P Hn ) T :H ^H n ®H n 
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Moreover applying the operator P H n to the identity (2.28) one derives 

P H »M + (n) - P Hn M* + (X)P 1 = (/i - A)P Hn7 ;(A)7 + (/i), n,\eC+. 

Combining these equalities we arrive at (5.69). Finally the second relation in (5.55) is 
equivalent to the first one. 
Now by Lemma 5.8 one has 

(5.70) Orifj) -n;(A) = Ou- A) 7 ;(A)7r(/i) +P*(\)(K* 01 (\)KM- 

-K{{\)KM - iK^WKMMn), n,\e C+, 

where 7 r ( - ) and /?(•) are given by (5.51) and (5.52). It follows from (5.37) that 

(5.71) a 3 (A) = 51(A) = (-M+(A) f # n / H n) : H n ® H n ^ Hi. 

Therefore the function /?(•) in (5.70) is defined by (5.63) and to prove the identity (5.64) 
it remains to show that 

(5.72) J* T (\hM = I U*{t, X)U T (t, fi) dt:=s- lim / U* T (t, X)U T (t, ix) dt. 

V\b o 

Combining (5.71) with (5.68) and using next (5.16) one obtains 

7r(A) = (-7+(A) r H n 0) - 7+ (A)(r + (A) + M + {X)Y\-M + {X) \ H n I Hn ) = 
= 7+(A)((-/ Wo + (r+(A) + M + (A))- X M + (A)) \ H n - (r + (A) + M + (A))^ \ H n ) = 
= 7+(A)(C (A) - C 1 (A)M + (A))- 1 (-C (A) \ H n C\(X) \ H n ) = 
= 7+(A)(C (A) - C 1 (A)M + (A))- 1 (-(7 2 (A) Ci(A)). 
This and (3.27), (5.60) give the equality 

(5.73) ( lT (X)h)(t) = U T (t, X)h, heH n ®H r \ AG C+. 
Now applying Lemma 4.4, 3) to the operator solution U T (-, A) one obtains 

7 ;(A)/ = / U;(t, X)f(t) dt := hm / CC(*, A)/(f) dt, / = /(t) G 
o ^Tf 1 o 

which together with (5.73) implies (5.72). 

The statement 2) of the proposition is immediate from the identity (5.64) and the 
inequality (2.13), which turns into the equality for r G R°(H ,Hi) (see Definitions 2.5 
and 2.6). □ 

5.3. The case of equal deficiency indices. In this subsection we suppose that the 
expression (3.1) obeys the condition nj, + = rib-, in which case n + (L ) = n_(L ). More- 
over we assume that II = {7i, To, r\} is a decomposing boundary triplet (3.12) for L, so 
that 7Yg = H' 1 =: Ti! and 7Yo = 'Hi ='■ H (see Definition 3.3). Our aim is to reformulate 
for this case the foregoing results on generalized resolvents and characteristic matrices. 
First of all, Theorem 5.1 can be restated as follows. 

Theorem 5.11. Under the above suppositions the relations 

(5.74) V(A(X)) = {yeV: C 1 (X)y^(0) + C 2 (X)y^(0) + C' (X)T' y - C[(X)r[y = 0}, 

R(A) = R T (A) = (A(X) — A) -1 , AgC+UC_ 

(with A(X) = L \ V(A(X))) establish a bijective correspondence between all generalized 
resolvents R(A) of the operator L and all Nevanlinna operator pairs 

(5.75) r(A) = {(C (A),Ci(A));/C} G R(H), X G C+ U C_ 
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(see Remark 2.7, 2)) defined by the block-matrix representations 

(5.76) C (A) = (C 2 (X) C' (X)) : H n —> fC, 

d(A) = (Ci(A) Ci(A)) :H n ®H'^lC, A g C+ U C_. 

Moreover R(A) a canonical resolvent if and only if r G R°(TC). 

Next with every operator pair r(-) G given by (5.75) and (5.76) we associate a 

family of operator solutions F r (-, A) : A — > [7i, i7] of the equation (3.4), defined by the 
initial data 

(5.77) y T (0, A) = (-CJ(A) C7i(A)) T (C*(A) - M(A)C*(A))- 1 , A G C+ U C_ 

(here M(A) is the corresponding Weyl function (3.29)). Then in view of (5.11)— (5.13) 
the Green function G T (x, t, A), corresponding to an operator pair r G R(H), is given by 
the equality (5.14), in which Y T (-,X) and Z (-,A) are the operator solutions (5.77) and 
(3.30) respectively. 

Now Theorem 5.3 implies the following result. 

Theorem 5.12. Let the above assumptions be satisfied. Then the equalities (5.14) and 
(5.15) give a bijective correspondence between all generalized (canonical) resolvents R(A) 
of the operator Lq and all operator pairs r G R{H) (respectively, r G R°(H)). 

Assume that II = {T-C,Tq,Ti} is a decomposing boundary triplet (3.12) for L and 
M(-) is the corresponding Weyl function (3.29). Then for every operator pair r G R{7i) 
the corresponding operator functions (5.17) and (5.21) generate the operator function 
^ r (-) : C + U C_ — > [H © H], defined by the block-matrix representation 
(5.78) 

n m _ ( M W ~ M(A)(r(A) + M(A))" 1 M(A) -±J W + M(A)(r(A) + M(A))^\ 
rlAj "V -|/« + (r(A) + M(A))- 1 M(A) " -(r(A) + M(A))- 1 J 

In view of (5.23)-(5.31) this function can be also represented as 

(5.79) n T (x) = 

_ / M(A)(C (A) - C7 1 (A)M(A))- 1 C7 (A) - M(A)(C (A) - C7 1 (A)M(A))' 1 C 1 (A)\ 

Vl / «-( C 'o(A)-C7 1 (A)M(A))- 1 C7 (A) " (C7 (A)-C7 1 (A)M(A))- 1 C7 1 (A) J 

where C (A) and Ci(A) are components of the operator pair r (see (5.75)). This and 
formula (5.32) show that the characteristic matrix Q T {-) of the operator Lq, corresponding 
to an operator pair r(-) G R(H), is defined by 

(5.80) Q T (X) = Pfln eH n £j T (A) \ H n ®H n , A G C+ U C_. 

The following theorem implied by Theorem 5.7 contains the description of all character- 
istic matrices of the operator L . 

Theorem 5.13. Let under the above assumptions A G Ext^ be the self adjoint extension 
(3.18) and letS{X)(e [H,H®H]), S{X)(e [H, H n © H n \) be operator functions given by 

S(X) := (-M(A) I n ) T :H^H®H, A g C + U C_ 

S(X) = P Hn(BH nS(X) = (~^ A) ~ M ^ X ^ :H n ®H' -> H n ®H n , A G C+ U C_. 

Then: (i) the characteristic matrix Qq(X) of the operator L corresponding to the canon- 
ical resolvent Ro(A) = (A — A) -1 is defined by (5.44); 
(ii)the equality 

(5.81) Q(X){=Q t (X)) = Q (X)-S(X){t(X) + M(X))- 1 S*(X), A G C+ U C_ 
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establishes a bijective correspondence between all characteristic matrices Q(A) of the op- 
erator L and all Nevanlinna operator pairs r(-) G R(7i). Moreover the characteristic 
matrix fl(X) in (5.81) is canonical, if and only if r(-) G R°(H). 

Next combining Propositions 5.9 and 5.10 we arrive at the following result. 

Proposition 5.14. Let under the above suppositions r(-) G R(7i) be a Nevanlinna op- 
erator pair (5.75), (5.76) and let (2.22) be an equivalent representation ofr(-). Then: 

1) for every A G C + U C_ there exists the unique pair of operator functions Uj T (-, A) G 
L' 2 [H n ,H], j G {1,2} obeying the equation (3.4) and the boundary conditions (5.59). 
Moreover, 

u jT (t, A) = (-ir%(t, A)(C (A) - C 1 (A)M(A))~ 1 C',(A), j G {1, 2}, A G C + U C_, 

where Z (-,X) is the operator solution (3.30). 

2) the identity (5.64) for the characteristic matrix Vt T {-) takes the form 

(5.82) Or(n) - n*{x) = (n - x) f u;(t, x)u T (t, dt + ^{\){k*{\)km- 

Jo 

-KZ(\)K (n))P(n), n, X G C + U C_, 
where U T (-, A) is the operator solution (5.62) and /3(A) (e [H n © H n , K!]) is given by 
/3(A) = (-(tfi(A) + M(X)K (X)y 1 M(X) \ H n (K^X) + M(A)K (A))- 1 \ H n ). 
Moreover, the inequality (5.66) holds for all /i G C + U C_. 

5.4. The case of minimal deficiency indices. In this subsection we show that for dif- 
ferential expressions l[y] with minimal deficiency indices n±(Lo) the previous statements 
can be rather simplified. 
Let 

(5.83) K = (K Kr) 1 :H n ^H n ®H n 

be a selfadjoint operator pair (that is 9 = {K , K\\ H n } G C(H n ) is a selfadjoint linear 
relation). With each such a pair we associate the operator solution c^(-,A) : A — > 

[H n , H] of the equation (3.4) defined by the initial data ^ } (0, A) = K , ^(0, A) = K x . 

Proposition 5.15. Let l[y] be a differential expression (3.1) with the deficiency indices 
rib± at the point b (see Definition 3.2). Then the following statements are equivalent: 

(i) n b+ = n b _ = 0; 

(ii) there exist a selfadjoint operator pair (5.83) and a pair of points X G C + and 
(j, G C_ such that 

(5.84) / \\ VK ( y t,X)h\\ 2 dt = f\\(p K (t,fi)h\\ 2 dt = oo, h G H n , h^O; 
o o 

(Hi) the relation (5.84) holds for all selfadjoint pairs (5.83) and for all X G C+ U C_. 
If in addition dim// < oo ; then the statements (i)-(iii) are equivalent to the equalities 
n + (L ) = n_(L ) = n-dimH, which means minimality of the deficiency indices n±(L ). 

Proof. Let 9 = {K , K\\ H n } G C(H n ) be a selfadjoint linear relation (operator pair) 
and let L e G Ext Lo be a symmetric extension with the domain (3.11). It is clear that 
for all A G C + U C_ a defect subspace yi\(Le) consists of all functions y G admitting 
the representation y = (p K (t,X)h with some h G H n . At the same time according to 
Definition 3.2 n b ± = n±(L e ) = dimyi\(L e ), X G C±. This and the relation 

y := ip K (t, X)h = Kh = h = 
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give the implications (i)=^(iii) and (ii) =^(i). Moreover, the implication (iii) =>-(ii) is 
obvious. Finally, the last statement is implied by the equality n±(L ) = n ■ dim// + 
n h ±. □ 

Proposition 5.16. Let the expression (3.1) satisfies at least one (and, hence, all) con- 
ditions (i)-(iii) from Proposition 5.15. Then: 

1) a triplet II = {H n , T , I\} with 

(5.85) r o y = y®(0), r iy = - y ^(o), y ev 

is a (unique decomposing) boundary triplet for L . Moreover, the corresponding self adjoint 
extension A is given by 

(5.86) V(A ) = {yeV: y^(0) = 0}, A = L \ V(A ); 

2) for every A G p{A$) there exists the unique operator solution vq(-,X) G L' 2 [H n ,H] 
of the equation (3.4) obeying the condition v^\o,X) = Ih™- Moreover, the ^-field 7(A) 
for the boundary triplet (5.85) is connected with i>o(-,A) by 

{l{X)h){t) = v (t, X)h, heH n , AG p(A ); 

3) the m-function m(-) : p(A ) — > [H n ] corresponding to the extension A is uniquely 
defined by the condition 

-c(t, A)m(A) + s(t, A) G L' 2 [H n , H], AG p(A ), 

which imply the equality m(X) = — Vq~\o,A). Moreover, the Weyl function M(-), corresponding 
to the boundary triplet (5.85), is defined by 

(5.87) M(A)=m(A), A G p(A ). 

Proof. The statement 1) is a consequence of the relation (3.15), while all other statements 
are immediate from Corollary 3.6. □ 

Now applying Theorems 5.11 and 5.12 to the boundary triplet (5.85) we arrive at the 
following theorem. 

Theorem 5.17. Let suppositions of Proposition 5.16 be satisfied. Then: 

1) the relations 

V(A(X)) = {yeV: dWi/Wfl)) + C (\)yV(0) = 0}, 2(A) = L \ V(A(X)) 

r(x) = r t (\) = (A(\) - xy 1 , AgC+UC_ 

establish a bijective correspondence between all generalized resolvents R(A) of the operator 
Lq and all Nevanlinna operator pairs 

(5.88) r(A) = {(C (A),C 1 (A));// n } G R(H n ), X G C+ U C_ 

Moreover M(A) is a canonical resolvent if and only if r G R°(H n ); 

2) the Green function G T (x,t,X), corresponding to the operator pair (5.88), is 

(5.89) G^.MJ-H 1 ' Ttl' X> Jf ' ^C + UC_, 

[(p T (x,X)v^(t,X), x<t 

where vo(-,X) is defined in Proposition 5.16, 2) and (fi T (-, X) : A — > [H n , H] is a solution 
of (3.4) with the initial data 

<p T (0, A) = (-C7*(A) C7*(A)) T (C*(X) - m(A)C7*(A))- 1 , A G C + U C_; 

3) the statement of Theorem 5.12 holds with the equality (5.89) instead of (5.14). 
Next, Theorem 5.13 can be reformulated as follows. 
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Theorem 5.18. Let the expression (3.1) satisfies at least one (equivalently, all) condi- 
tions (i)-(iii) from Proposition 5.15 and let m(-) be the m-function corresponding to the 
extension (5.86). Then: 

1) the characteristic matrix Q T (-) of the operator L , corresponding to a Nevanlinna 
operator pair (5.88), is defined by (5.78) (or, equivalently, (5.79)) with Q T (X) in place of 
n T (X) and M(X) = m(X); 

2) the statements of Theorem 5.13 hold with r(-) G R(H n ) and 

S(X) = (— m(A) Ih") T '■ H n — > H n © H n , M(X) — m(\), AgC + UC_. 
Finally, Proposition 5.14 gives the following result. 

Proposition 5.19. Let under the hypothesis of Theorem 5.18 r(-) G R(H n ) be a Nevan- 
linna operator pair (5.88) and let r(X) = {K (X), Ki(X); H n } be an equivalent represen- 
tation of r(-) (c.f (2.22);. Then: 

1) for every X G C + U C_ there exists the unique pair of operator functions Uj T (-, X) G 
L' 2 [H n , H], j G {1,2} obeying the equation (3.4) and the boundary conditions 

C 1 (X)uV(0,X) + C o (X)u ( $(0,X)) = d(A), C 1 (A)4 1 r ) (0,A) + C (A)4 2 r ) (0,A)) = -C (A). 
Moreover, the functions Uj T (-, A) are connected with the operator solution vq(-,X) by 
u lT (t, A) = v (t, X)(C (X) - C 1 (A)m(A))- 1 C 1 (A), 
u 2r (t, A) = -v (t, X)(C (X) - C 1 (A)m(A))- 1 C (A), A G C + U C_. 

2) the characteristic matrix fl T (-) obeys the identity (5.82), in which U T (-,X) is the 
operator solution (5.62) and 

/3(A) = (-(MX) + m(X)K (X))- l m(X) (K t (X) + m(X)K (X))- 1 ) : H n @ H n -> H n . 

Moreover, the inequality (5.66) holds for all \i G C + U C_. 

Remark 5.20. 1) In the case dimH < oo Proposition 5.16 was proved in [7]. 

2) For a scalar Sturm-Liouville differential expression l[y] = —y" + qy on the semiaxis 
[0, oo) with deficiency indices n±(L ) = 1 (the limit point case) Theorem 5.17 and the 
statement 1) of Theorem 5.18 were proved in [10, 9]. Observe also the papers [11, 12], 
where similar results were obtained for finite-dimensional Hamiltonian systems in the 
limit point case. 
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